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PREFACE 


The  Community  Health  Service  (CHS)  commissioned  Arthur  D.  Little,  Inc., 
(ADD  to  develop  several  conceptual  models  for  the  structure  and  function  of 
prototype  Professional  Standards  Review  Organizations  (PSRO)  as  described  in 
the  Social  Security  Amendments  of  1972  (P.L.  92-603).  The  work  was  initiated 
during  July  1972  under  the  terms  of  Contract  HSM  1 10-72-325. 

The  present  book  is  the  result  of  these  efforts.  It  has  been  published  in  the  hope 
of  providing  resource  information  to  the  many  persons  and  agencies  now  vitally 
interested  in  the  development  of  Professional  Standards  Review  Organizations. 

The  work  was  initially  based  upon  a  careful  review  of  the  pertinent  Hterature  and 
study  of  existing  approaches  to  medical  care  appraisal.  The  bibliography  and 
state-of-the-art  papers  which  resulted  are  included  in  the  present  volume.  These 
efforts  were  jointly  funded  by  the  above-mentioned  contract  with  the 
Community  Health  Service  and  by  a  contract  with  the  National  Center  for  Health 
Services  Research  and  Development  (HSM  1  10-72-269).  This  latter  contract  called 
for  an  evaluation  of  Experimental  Medical  Care  Review  Organizations  (EMCRO) 
and  provided  a  pertinent  opportunity  to  study  eight  current  experimental 
prototypes  of  PSRO  in  greater  depth.  We  were  gratified  by  the  symbiotic  nature 
of  these  two  contracts  and  the  opportunity  to  help  coordinate  the  two  related, 
yet  distinct,  projects. 

Our  efforts  required  careful  study  of  P.L.  92-603  and  its  periodic  markups  during 
passage  through  the  Congress.  A  plain  English  restatement  of  this  legislation  has 
been  included  in  the  Appendix  to  this  volume.  We  were  directed,  but  not 
constrained,  by  the  specific  language  of  the  legislation.  We  did  consider 
approaches  to  peer  review,  which  were  not  specifically  identified  in  the  bill,  when 
we  thought  them  both  productive  and  consistent  with  the  intent  of  the 
legislation;  we  specifically  avoided  those  functional  areas  of  review  which  were 
contraindicated  by  the  terms  of  the  legislation. 

Both  inductive  and  deductive  methods  were  used  in  the  analysis.  Pertinent 
substantive  concepts  from  the  literature  and  our  study  of  current  peer  review 
methods  were  organized  in  the  form  of  discussional  agenda.  These  materials  were 
presented  to  and  challenged  by  a  panel  of  experts,  including:  Paul  Bonner,  Barry 
Decker,  Jack  Kasten,  John  Mannix,  H.  Richard  Nesson,  Russell  Roth,  and  John 
Thompson.  The  specific  disciplines  and  major  experience  of  each  panel  member  is 
summarized  in  the  following  grid. 
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Completion  of  the  consulting  work,  and  the  preparation  of  this  volume,  was  made 
possible  by  the  devoted  efforts  of  the  panel  members,  who  were  able  to 
successfully  pool  their  experience  and  judgment  and  to  rapidly  function  as  a 
group  without  loss  of  individual  input  or  perspective.  The  attitudes  of  the  group 
varied  from  optimism  for  the  ultimate  value  of  the  bill  to  a  pessimistic  belief  that 
the  legislation  is  unworkable.  Tentative  conclusions  reached  by  analysis  were 
summarized  in  draft  form  and  reviewed  by  each  member  of  the  panel.  Their 
comments  and  suggestions  were  incorporated  in  the  final  reports.  While  it  is 
impossible  to  accommodate  all  shades  of  thought,  we  believe  that  the  present 
volume  accurately  reflects  the  combined  opinion  of  the  panel  and  incorporates 
important  individual  dissent. 

Sections  of  the  bibliography  and  individual  state-of-the-art  papers  were  prepared 
by  specific  members  of  the  ADL  case  team,  as  indicated  in  the  text.  These  authors 
contributed  significantly  to  the  progress  of  the  consultation  and  to  the 
preparation  of  this  volume. 

All  of  us  are  deeply  indebted  to  our  project  officers,  Sheridan  L.  Weinstein,  M.D. 
and  Leonard  J.  Janchar,  M.D.  of  the  Community  Health  Service.  In  addition  to 
financial  support,  they  graciously  gave  their  time,  interest,  advice,  and  frequently 
participated  in  the  panel  discussions. 
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We  are  also  indebted  to  Miss  Nancy  Richardson  and  Mrs.  Debbie  Zucco.  They  are 
the  unsung  secretarial  heroes  who  laboriously  typed  the  components  of  this 
manuscript  and  faithfully  met  each  and  every  deadline. 

The  work,  which  this  volume  describes,  had  a  simple,  inherent  logic.  It  began  with 
a  literature  review  and  study  of  existing  approaches  to  peer  review,  followed 
sequentially  by  panel  analysis  of  the  guidelines,  organizations,  and  relationships 
required  to  implement  PSRO.  These  panel  discussions  were  not  uniquely  directed 
towards  the  preparation  of  a  consulting  report;  rather  they  wandered  with  fits  and 
starts  and  with  considerable  reiteration.  No  effort  has  been  made  in  the 
arrangement  of  the  present  volume  to  follow  the  exact  chronology  of  the 
consulting  work  nor  the  specific  detail  of  the  panel  discussions.  In  fact,  we  have 
reversed  the  order  of  development  in  the  interest  of  what  we  believe  to  be  a  better 
presentation  of  the  material. 

Part  I  presents  the  substance  of  the  panel's  PSRO  considerations.  It  begins  with 
the  origin,  nature,  and  significance  of  the  legislation  followed  by  a  description  of 
the  panel's  perspectives  for  professional  review.  Part  I  then  presents  the  content 
of  peer  review,  its  application  to  the  functions  of  PSRO,  and  the  details  of 
individual  peer  review  programs.  The  balance  of  Part  I  deals  sequentially  with 
PSRO  districting,  the  organization  and  necessary  relationships  of  PSRO's,  State 
Councils,  and  the  National  Program. 

Part  II  presents  the  state-of-the-art  papers  prepared  by  members  of  the  case  team. 
Since  these  papers  helped  the  members  of  the  panel  to  conduct  the  analysis,  we 
have  assumed  they  would  have  similar  value  for  others  interested  in  the 
development  of  PSRO's.  For  this  reason,  the  papers  have  been  included  in  the 
present  text. 

The  Appendix  to  the  present  volume  (Part  III)  provides  the  reader  with  additional 
resources  pertinent  to  PSRO  and  peer  review.  We  have  included  a  simple 
restatement  of  the  legislation  (P.L.  92-603),  a  glossary  of  selected  terms,  and  the 
bibhography  on  medical  care  appraisal,  which  we  prepared. 

The  materials  for  this  volume  were  developed  between  July  1972  and  March 
1973.  P.L.  92-603  was  signed  into  law  late  in  1972,  perhaps  one  year  earlier  than 
any  of  us  had  expected.  As  a  result,  we  worked  under  the  pressure  of  mounting 
demands  for  useful  products  including  descriptions  of  available  guidelines  and 
recommendations  for  regulations  to  implement  PSRO.  These  time  constraints 
required  discussion  of  programs  which  have  not  yet  been  fully  evaluated.  We 
appreciate  the  need  for  further  evaluation  and  look  forward  to  rereading,  and 
perhaps  rewriting,  this  volume  when  better  evidence  concerning  the  impact  of 
these  programs  becomes  available. 
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Lacking  documented  impact  evaluations,  we  had  to  stumble  along,  as  best  we 
could,  with  only  prospective  estimates  to  chart  the  best  course.  At  times  vision 
was  clouded  by  the  intensity  of  competing  advocacy  for  conflicting  but  unproven 
methods.  Nevertheless,  if  our  efforts  help  others  to  walk  the  PSRO  path  a  little 
more  surely,  our  purpose  will  have  been  accomplished. 

Cambridge,  Massachusetts  Barry  Decker,  M.D. 

April  1973 
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P.L.  92-603:  THE  BENNETT  AMENDMENT 


P.L.  92-603  (the  Bennett  Amendment)  is  presented  in  its  entirety  in 
Appendix  A.  In  the  interests  of  simpHcity,  the  original  legislative  language  has 
been  translated  into  plain  English  and  the  components  of  the  legislation 
regrouped  in  functional  rather  than  statutory  categories. 

A.  HISTORY  OF  THE  LEGISLATION 

The  legislation  originated  with  proposals  by  the  American  Medical  Associa- 
tion (AM A)  for  the  development  of  Peer  Review  Organizations  (PRO)  by  State 
Medical  Societies.  This  proposed  mechanism  for  cost  control  was  incorporated  in 
the  AMA's  Medicredit  Plan,  which  was  introduced  in  the  House  on  July  21,  1970 
by  Representatives  Fulton  and  Broyhill  under  the  title  Health  Insurance 
Assistance  Act  of  1970.' 

As  proposed,  the  Secretary  of  HEW  would  enter  into  agreements  with  State 
Medical  Societies  to  establish  Peer  Review  Organizations  (PRO's).  Each  PRO 
would  include  a  five  member  Commission  and  a  nine  member  Advisory  Council. 
Each  PRO  Commission  would  divide  its  State  into  administrative  districts  and 
appoint  a  three  member  local  review  panel  and  a  five  member  local  advisory 
council.  The  State  PRO  Commission  and  the  local  review  panels  would  only 
include  physicians.  These  panels  were  to  review  information  supplied  by 
individuals,  institutions,  hospitals,  government  agencies,  and  carriers  as  well  as  a 
random  selection  of  cases  for  peer  review.  Where  patterns  of  abuse  were  detected, 
the  PRO  could  recommend  to  the  Secretary  suspension  or  exclusion  from  the 
program,  and  in  the  case  of  fraud,  the  PRO  could  bring  charges  before  the 
appropriate  licensing  body. 

The  PRO  proposals  of  the  American  Medical  Associations  were  also 
submitted  to  Senator  Wallace  Bennett  of  Utah  for  possible  introduction  in  the 
Senate.'^  Senator  Bennett  "forwarded  the  proposal  to  the  Finance  Committee 
staff  for  comment  and  analysis  in  terms  of  their  experience  with  the  medicare  and 
medicaid  programs  and  in  the  light  of  hearing  and  other  review  activities." 
According  to  Senator  Bennett,  the  Finance  Committee  staff  felt  that: 


'Congressional  Record-House,  July  23,  1970. 
^Congressional  Record-Senate,  July  1,  1970 
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"the  AMA  plan  was  unduly  limited  and  a  number  of  suggestions, 
modifications,  and  extensions  were  recommended  ....  that  the  staff  be- 
lieved would  reflect  the  attitude  in  their  recent  report  on  medicare  and 
medicaid  that:  The  key  to  making  the  present  system  workable  and 
acceptable  is  the  physician  and  his  medical  society". 

In  this  same  address.  Senator  Bennett  indicated  his  intention  to  propose  an 
amendment  for  Professional  Standards  Review  Organizations  (PSRO),  based  on 
the  AMA  draft  proposals  as  modified  by  the  suggestions  of  the  Finance 
Committee  staff.'  The  original  PSRO  Amendment  was  proposed  shortly 
thereafter  and  is  recorded  in  the  Congressional  Record-Senate  of  August  20, 
1970. 

The  philosophic  base  of  the  PSRO  Amendment  is  best  expressed  in  the 
Senator's  own  words.' 

"I  believe  that  physicians,  properly  organized  and  with  a  proper  mandate, 
are  capable  of  conducting  an  ongoing  effective  review  program  which  would 
eliminate  much  of  the  present  criticism  of  the  profession  and  help  enhance 
their  stature  as  honorable  men  in  an  honorable  vocation  willing  to  undertake 
necessary  and  broad  responsibility  for  overseeing  professional  functions.  If 
medicine  accepts  this  role  and  fulfills  its  responsibility,  then  the  Government 
would  not  need  to  devote  its  energies  and  resources  to  this  area  of  concern. 
Make  no  mistake:  the  direction  of  the  House-passed  social  security  bill  is 
towards  more-  not  less-  review  of  the  need  for  and  quality  of  health  care.  I 
believe  my  amendment  would  provide  the  necessary  means  by  which 
organized  medicine  could  assume  responsibility  for  that  review. 

In  my  opinion,  if  ultimately  enacted,  the  Professional  Standards  Review 
proposal  now  being  drafted  would  provide  physicians  with  an  imaginative 
and  exciting  opportunity  to  assume  basic  responsibility  for  reviewing  health 
care  as  a  whole.  It  would  scrap  the  piecemeal  review  activities  of  varying 
effectiveness  which  have  prevailed  since  1966." 

The  Senate  Finance  Committee  approved  a  modified  form  of  the  Bennett 
Amendment  (No.  851)  to  the  pending  social  security  bill  during  October,  1970. 
Final  action  on  the  bill,  however,  was  not  taken  by  the  91st  Congress.  The  bill 
was  reintroduced  to  the  92nd  Congress  as  Amendment  No.  823  to  the  Social 
Security  Act  (H.R.I)  on  January  25,  1972.  It  was  referred  to  the  Committee  on 
Finance  and  ordered  to  be  printed. 


'Congressional  Record-Senate,  July  1,  1970. 
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The  bill  was  again  modified  before  it  was  reported  out  by  the  Senate  Finance 
Committee  late  in  1972.  Section  1 170  authorizing  demonstration  projects  to  test 
the  feasibility  and  economies  of  prepayment  through  PSRO's  was  eliminated. 

The  Bennett  Amendment,  as  modified  by  the  Finance  Committee,  was 
passed  by  the  Senate  and  referred  to  a  House-Senate  Conference  Committee.  As  a 
result  of  that  conference,  the  House  receded  (accepting  the  amendment)  with  the 
following  modifications: ' 

(1)  "Until  January  1,  1976,  the  Secretary  would  be  able  to  make  an 
agreement  only  with  a  qualified  organization  which  represents  a 
substantial  proportion  of  the  physicians  in  the  geographic  area 
designated  by  the  Secretary. 

(2)  A  professional  standards  review  organization  would  not  be  required  to 
review  other  than  institutional  care  and  services  unless  such  organiza- 
tion chooses  to  include  the  review  of  other  services  and  the  Secretary 
agrees. 

(3)  Until  January  1,  1976,  at  the  request  of  10  percent  or  more  of  the 
practicing  physicians  in  a  geographic  area  designated  by  the  Secretary, 
the  Secretary  would  be  required  to  poll  the  practicing  physicians  in  the 
area  as  to  whether  or  not  an  organization  of  physicians  which  has 
requested  to  conclude  an  agreement  with  the  Secretary  to  establish  a 
professional  standards  review  organization  in  this  area  substantially 
represents  the  practicing  physicians  in  that  area.  If  more  than  50 
percent  of  the  practicing  physicians  in  the  area  responding  to  the  poll 
indicate  that  the  organization  does  not  substantially  represent  the 
practicing  physicians  in  the  area,  the  Secretary  could  not  enter  into  an 
agreement  with  that  organization." 

B.  MAJOR  PROVISIONS  OF  P.L.  92-603 

The  legislation  authorizes  the  Secretary  of  HEW  to  designate  specific  areas  of 
the  country  by  January  1,  1974,  and  to  establish  conditional  contracts  for  a 
PSRO  in  each  area  as  soon  as  possible  thereafter.  Prior  to  January  1,  1976,  the 
Secretary  may  only  contract  with  qualified  organizations  which  represent  a 
majority  of  the  physicians  in  each  area,  who  respond  to  polling.  A  qualified 
organization  is  a  voluntary  professional  association,  without  requirement  for  dues, 
which  represents  300  or  more  physicians. 


'Congressional  Record-House,  October  14,  1972. 
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State  Councils  are  authorized  in  any  State  with  three  or  more  PSRO's  to 
include  representation  from  each  PSRO  in  the  State,  other  physicians,  and  the 
public.  A  National  Council  will  be  appointed  by  the  Secretary,  which  will  include 
eleven  physicians,  with  a  majority  nominated  by  national  physicians'  organiza- 
tions. 

The  PSRO's  will  monitor  the  appropriateness  of  utilization  and  the  quality 
of  institutional  services  provided  to  beneficiaries  of  the  Social  Security  Act  (i.e.. 
Medicare  and  Medicaid).  They  will  be  concerned  with  the  necessity  for  and 
quality  of  care,  and  with  the  use  of  an  appropriate  level  of  service,  but  will  not  be 
required  to  determine  the  reasonableness  of  individual  charges.  The  use  of  cost 
data,  however,  as  a  surrogate  for  utilization,  is  not  excluded  by  the  legislation. 
With  the  concurrence  of  the  Secretary,  PSRO's  have  the  option  to  monitor 
ambulatory  services,  as  well. 

PSRO's  will  utilize  norms  of  care  based,  on  typical  patterns  of  practice  in  the 
region,  to  evaluate  the  appropriateness  of  utilization  and  the  quality  of 
institutional  services.  Regional  norms  must  be  approved  by  the  National  Council. 
Justification  will  be  required  for  any  regional  norms  which  significantly  deviate 
from  national  norms. 

PSRO's  are  encouraged  to  use  the  services  of  many  practicing  physicians  in 
the  conduct  of  their  reviews  and  to  delegate  responsibility  for  review  to  hospitals, 
HMO's,  and  other  group  practices  which  have  demonstrated  the  capability  to 
conduct  adequate  reviews.  Within  this  framework,  PSRO's  are  charged  with  the 
responsibility  for: 

•  Precertification  of  institutional  services, 

•  Periodic  sample  reviews  by  diagnosis  or  condition, 

•  Regular  review  of  patient  and  provider  profiles, 

•  Monitoring  the  certification  requirements  of  SSA, 

•  Physician  education  concerning  the  program,  and 

•  Appropriate  reporting  of  violations. 

The  State  Councils  will  coordinate  and  integrate  the  activities  of  the  various 
PSRO's,  serve  as  an  appeal  agent,  and  assist  the  Secretary  in  the  conduct  of  the 
program. 
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The  National  Council  will  prepare,  revise,  and  distribute  regional  norms, 
provide  technical  assistance  in  the  use  of  these  norms,  review  the  performance  of 
the  State  Councils  and  PSRO's,  and  advise  both  the  Secretary  and  the  Congress  on 
the  progress  of  the  program. 

PSRO's  are  authorized  to  undertake  professional  inquiry  before  and/or  after 
the  provision  of  any  service  covered  by  the  legislation;  to  examine  pertinent 
records;  and  to  inspect  physical  facilities  where  such  care  is  rendered.  After 
proper  notification,  no  Medicare  or  Medicaid  claim  will  be  paid  if  the  service  is 
subject  to  the  review  of  a  PSRO  and  has  been  disapproved.  Each  health  care 
provider  and  practitioner  is  obligated  to  provide  services  consistent  with  the 
intent  of  the  Amendment.  Recurrent  or  flagrant  violations  may  lead  to  exclusion 
from  the  program  or  a  fine.  An  appeals  route  is  defined  for  dissatisfied  patients, 
practitioners,  or  providers. 

The  legislation  provides  for  the  transitional  assumption  of  PSRO  duties  over 
a  two-year  conditional  period  and  for  the  continuation  of  presently  authorized 
reviews  during  the  transition.  Appropriate  funding  through  the  Hospital  Insurance 
Trust  Fund  and  the  Supplementary  Medical  Trust  Fund  is  provided  for  technical 
assistance  and  the  reasonable  and  necessary  expenses  of  PSRO's,  State  Councils, 
and  the  National  Council. 

C.  MAJOR  OBJECTIVES  OF  THE  LEGISLATION 

The  legislation  is  designed  to  utilize  professional  expertise  through  peer 
review,  subject  to  public  accountability,  to  assure  the  appropriateness  and  quality 
of  institutional  services  purchased  under  provisions  of  the  Social  Security  Act. 

The  explicit  objectives  of  the  legislation  include  review  of  the  services 
provided  all  federal  beneficiaries  to  evaluate  the: 

(1)  necessity  for  institutional  admission, 

(2)  duration  of  institutional  service, 

(3)  appropriateness  of  the  level  of  institutional  care,  and 

(4)  adequacy  and  relevance  (quality)  of  the  service  provided. 
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The  implied  objectives  of  the  legislation  are  to: 

(1)  contain  the  utilization,  and  thereby  the  cost,  of  federal  health  services, 
and  at  a  minimum, 

(2)  assure  that  the  services  purchased  are  medically  necessary  and  appro- 
priate. 

D.  THE  ROLE  OF  P.L.  92-603  IN  THE  FEDERAL  HEALTH  STRATEGY 

Federal  health  strategy,  in  the  nineteen  seventies,  is  dominated  by  two 
related  concerns:  (1)  the  imminence  of  national  health  insurance;  and  (2)  the 
need  to  prevent  inflationary  pressures  produced  by  augmented  purchasing  power, 
a  shortage  of  medical  professionals,  and  an  excess  of  hospital  beds. 

Representative  Richard  Fulton  of  Tennessee,  while  introducing  the  AM  A 
Medicredit  Plan,  inserted  the  following  comment  in  the  Congressional  Record  of 
July  21,  1970:  "The  idea  of  national  health  insurance  is  an  idea  whose  time  has 
come.  The  question  is  no  longer  whether  or  not  we  need  a  national  insurance 
plan.  The  question  is  what  plan?  And  when  can  we  develop  one  that  works?" 

Whether  any  national  health  insurance  plan  works  or  not  will  depend,  in 
good  measure,  on  its  ability  to  equitably  distribute  scarce  medical  resources.  The 
failure  of  such  rationing  will  lead  to  market  competition  and  inflationary  prices 
for  medical  services.  It  is  true  that  a  ceiling  can  be  imposed,  and  possibly 
enforced,  on  unit  medical  prices.  It  is  far  more  difficult,  however,  to  control  the 
over-utilization  of  services,  and  particularly  the  over-utiUzation  of  hospital  services 
in  the  presence  of  empty  hospital  beds. 

Federal  strategy  to  counter  the  shortage  of  physicians  has  been  based  on:  (1) 
stimulation  of  the  number  of  medical  graduates;  (2)  increased  medical  capacity 
through  the  use  of  physician  expanders,  such  as  physicians'  assistants,  nurse 
practitioners,  and  nurse  clinicians;  and  (3)  increased  medical  capacity  through  the 
use  of  automated  diagnostic  systems. 

Federal  strategy  to  counter  the  excess,  and  possible  maldistribution,  of 
hospital  beds  has  been  based  on:  (I)  comprehensive  area-wide  health  planning; 
and  (2)  elimination  of  Hill-Burton  grants  for  hospital  construction  and  renova- 
tion. 

PSRO  represents  the  federal  strategy  to  equitably  distribute  medical 
resources.  PSRO  has  been  designed  to  assure,  in  the  absence  of  price  constraints, 
that  the  services  provided  are  necessary,  of  adequate  quality,  and  performed  as 
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economically  as  possible.  In  effect,  PSRO  is  a  form  of  non-price  rationing  which 
limits  the  use  of  scarce  medical  resources  to  those  situations  where  they  are  most 
necessary  and  appropriate. 

PSRO  will  have  little  impact  if  all  the  medical  services  now  performed  are 
necessary,  of  adequate  quality,  and  performed  in  the  most  economic  manner.  If, 
as  is  likely,  current  medical  services  sometimes  fail  to  meet  these  standards,  PSRO 
may  salvage  resources  and  help  the  existing  medical  plant  to  better  meet  the 
demands  it  faces,  without  destructive  inflation. 

PSRO  is  then  a  managerial  tool.  It  is  a  governmental  plea  for  medical 
involvement  in  the  effective  and  efficient  distribution  of  medical  services,  in  the 
absence  of  price  constraints.  It  is  a  necessary  precursor  to  the  further  public 
assumption  of  responsibility  for  the  financing  of  health  care.  PSRO  is  organized 
medicine's  opportunity  for  self  regulation.  Given  the  pressures  which  now  exist 
for  national  health  insurance,  failure  of  PSRO  may  well  initiate  other,  less 
workable,  forms  of  bureaucratic  control  over  the  practice  of  medicine. 
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THE  PERSPECTIVE  OF  PROFESSIONAL  REVIEW 


The  members  of  the  consulting  panel,  who  developed  this  report,  were 
selected  to  provide  specific  skills.  No  member  spoke  officially  for  any  organized 
segment  of  the  health  care  community.  Nevertheless,  the  prior  experience  and 
current  positions  of  the  panel  members  permitted  a  sensitive  appreciation  for  the 
unique  interests  of  such  varied  groups  as  physicians,  hospitals,  intermediaries,  and 
the  public. 

Despite  their  diverse  backgrounds,  the  consulting  panel  members  shared 
certain  common  viewpoints  concerning  PSRO.  These  perceptions  influenced  the 
analysis  of  issues  and  determined  most  of  the  recommendations  which  were 
developed.  It  is  appropriate  therefore,  to  preface  the  substantive  portions  of  this 
book  with  a  brief  orientation  to  the  panel's  perspective. 

The  consulting  panel  perceived  significant  differences  between  claims  review, 
as  it  is  normally  conducted,  and  professional  review.  Since  these  terms  do  not 
always  carry  the  same  meaning  to  different  people,  reasonably  precise  definitions 
are  necessary. 

Claims  review  is  a  retrospective  process  which  begins  with  the  initiation  of  a 
claim  for  payment  after  the  completion  of  a  service.  The  claims  process,  from 
receipt  to  payment,  usually  includes: 

•  A  check  for  the  completion  of  all  necessary  items  on  the  form; 

•  A  determination  that  the  beneficiary  is  indeed  eligible  and  that  the 
contract  covers  the  services  provided;  and 

•  A  check  that  charges  are  consistent  with  usual  and  customary  individual 
fees  or  published  institutional  rates. 

In  most  cases,  claims  review  is  limited  to  the  activities  described  above,  and 
is  primarily  designed  to  determine  or  verify  the  existence  of  a  contractual 
obligation  on  the  part  of  the  intermediary  to  pay  for  the  service  billed. 

Infrequently,  an  attempt  is  made  during  claims  review,  to  evaluate  the 
necessity  for  a  billed  service.  This  has  been  approached  by  individual  case  review 
or  by  comparison  of  statistical  summaries  describing  the  volumes  or  costs  of  care 
in  specific  categories.  In  the  former  case,  individual  lengths  of  stay  or  specific 
surgical  procedures  are  screened  by  a  reviewer  in  relation  to  the  discharge 
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diagnosis.  Seemingly  inappropriate  relationships  are  presented  to  a  medical 
consultant,  or  an  expert  panel,  for  judgmental  review.  The  criteria  for  these 
comparisons  may  be  implicit  (the  best  opinion  of  the  reviewers,  consultants,  or 
expert  panels)  or  explicit  (empiric  norms  for  length  of  stay  and  normative  criteria 
for  quality  of  care).  The  statistical  approach  is  based  on  aggregate  utilization  or 
cost  data  to  describe  discharges,  days  of  care,  or  the  use  of  .specific  services  by 
individual  physicians,  particular  departments,  or  entire  institutions.  These 
statistical  summaries  may  be  developed  for  all  patients  or  for  patients  with 
specific  diseases.  Comparisons  are  made  with  prior  time  periods  or  with  seemingly 
comparable  institutions.  Save  for  these  infrequent  approaches,  the  relevance  or 
appropriateness  of  medical  service  is  rarely  evaluated  by  the  usual  claims  review 
process.  Evaluation  of  the  quality  of  medical  care  is  even  less  common  in  the 
usual  claims  review  process. 

Professional  review,  unlike  claims  review,  may  be  prospective,  concurrent,  or 
retrospective.  It  is  designed  to  evaluate  both  the  quality  and  the  economics  of 
medical  care.  Professional  review  generally  includes  an  evaluation  of  the: 

•  Relevance  of  individual  services  to  each  patient's  specific  needs,  as 
determined  by  his  diagnosis; 

•  Appropriateness  of  the  level  of  care  to  each  patient's  particular  medical 
needs; 

•  Volume  of  services  provided  in  each  instance; 

•  Appropriateness  of  the  outcome,  including  complications,  indications 
for  discharge,  and  the  provision  of  follow  through  services;  and 

•  Appropriateness  of  the  services  provided  to  populations  as  a  measure  of 
the  accuracy  of  diagnosis  and  the  adequacy  of  case  finding. 

The  input  requirements  for  claims  review  include  the  initiating  claim  for 
payment,  an  eligibility  file,  and  selected  criteria.  The  latter  are  generally  limited 
to  usual  and  customary  fee  scales,  institutional  rate  schedules,  and  empiric  norms 
for  length  ot  stay  by  diagnosis.  More  sophisticated,  but  infrequent,  programs  may 
also  require  criteria  which  specify  appropriate  surgical  procedures  for  each 
diagnosis.  Sophisticated  programs  dealing  with  statistical  summaries  require  stored 
data  describing  prior  experience  for  comparison  with  current  performance. 

Professional  review  requires  a  much  more  detailed  abstract  of  each  case  than 
does  claims  review.  The  abstract  generally  includes  more  diagnostic  subspecifica- 
tions  and  details  of  both  the  services  provided  and  liie  volumes  of  care.  Certain 
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aspects  of  professional  review  also  depend  upon  an  aggregation  of  data  to  provide 
institutional  or  population  based  summaries. 

In  general  claims  review  has  an  accounting  emphasis  while  professional 
review  has  a  medical  emphasis.  Claims  review  is  necessarily  retrospective  and 
requires  less  detailed  information  than  professional  review.  Claims  review  is 
oriented  towards  a  pay,  no  pay  decision.  Professional  review,  while  it  may  provide 
a  pay,  no  pay  decision,  is  oriented  towards  educational  outputs  which  modify 
physician  performance. 

Some  aspects  of  professional  review  can  be,  and  have  been,  based  upon  data 
provided  by  claims  review.  Total  professional  review,  however,  cannot  be 
performed  with  claims  review  data  alone  for  the  following  reasons: 

( 1 )  Retrospective  claims  data  do  not  permit  the  prospective  or  concurrent 
aspects  of  professional  review; 

(2)  Claims  review  methods  do  not  provide  the  educational  output  required 
for  professional  review; 

(3)  The  data  on  claims  forms  are  too  limited  and  too  inaccurate  for  most 
professional  review. 

For  these  reasons,  the  panel  understands  professional  standards  review  as 
related  to,  yet  separate  and  distinct  from,  claims  review. 

P.L.  92-603  mandates  both  claims  review  (reimbursement  control)  and 
professional  review  (education).  The  former  promotes  short-term  impacts  which 
influence  federal  expeditures;  the  latter  promotes  long-term  impacts  which 
influence  national  health  care  costs  and  the  quality  of  medicine. 

Reimbursement  control  can  be  achieved  equally  as  well  by  combining 
professional  review  and  claims  review  or  by  appropriately  reporting  the  results  of 
independent  professional  review  to  the  intermediaries  responsible  for  claims 
processing.  Education  leading  to  modified  physician  behavior,  however,  requires 
professional  review  activities  and  organizations  which  basically  differ  from  the 
usual  methods  of  claims  review. 

The  panel  recognized  the  dependence  of  some  existing  professional  review 
models  on  the  input  of  claims  review  data.  This  approach  is  most  common  in 
those  sites  or  agencies  dominated  by  fiscal  or  accounting  concerns. Though  claims 
forms  currently  provide  the  only  source  of  data  for  the  review  of  non- 
institutional,  fce-for-service,  ambulatory  care,  other  and  better  data  sources  exist 
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for  the  professional  review  of  institutional  care.  The  panel  was  aware  of  many 
models  of  professional  review  which  do  not  depend  upon  the  input  of  claims  form 
data.  Examples  of  such  reviews  include: 

•  Precertification   based   on   the   information   in  an  application  for 
admission; 

•  On-Site  Concurrent  Hospital  Review  based  on  the  direct  observations  of 
a  nurse  coordinator;  and 

•  Retrospective  audits  of  hospital  practice  based  on  detailed  discharge 
abstracts. 

In  consequence,  while  recognizing  the  need  for  reporting  professional 
judgments  to  the  claims  processor,  the  panel  sought  alternatives  to  claims  review 
as  the  basis  for  professional  standards  review.  In  the  judgment  of  the  consulting 
panel,  such  alternatives  offer  a  better  data  base  for  professional  review  and  a 
greater  promise  of  educational  impact.  These  perceptions  are  important  to  the 
subsequent  analysis  since,  by  implication,  they  free  prototype  PSRO's  from 
exclusive  dependence  upon  the  existing  organization  for  claims  review. 

The  panel  perceived  a  necessary  interdependence  between  the  care  provided 
federal  beneficiaries  and  the  balance  of  the  private  health  delivery  system. 

Legal  constraints,  public  demands,  and  professional  attitudes  make  it 
impossible  to  justify  two  standards  of  medical  care  in  our  contemporary  society. 
The  consulting  panel  understood  P.L.  92-603  to  mandate  professional  review  only 
for  the  beneficiaries  of  the  Social  Security  Act.  More  importantly,  the  panel 
appreciated  that  this  restriction,  except  in  terms  of  dollar  support  for  the  activity, 
is  literally  impossible. 

The  norms  of  care  and  most  of  the  forms  of  professional  audit,  developed 
for  federal  beneficiaries  under  PSRO,  will  ultimately  be  applied  to  all  private 
medical  services.  In  addition  to  their  inherent  resistance  to  separating  "federal 
care"  from  "medical  care,"  as  evidenced  by  the  common  extension  of  utilization 
review  to  private  hospital  care,  physicians  are  aware  of  the  public  and  legal 
pressures  to  extend  PSRO  norms  and  reviews  to  the  entire  private  health  delivery 
system. 

This  perception  is  important  to  the  subsequent  analysis  of  PSRO  prototypes. 
Despite  the  legal  limitations  of  P.L.  92-603,  PSRO  norms  and  audit  method- 
ologies must  be  applicable  to  private  medical  care  and,  therefore,  acceptable  to 
the  private  health  delivery  system.  In  consequence,  PSRO's  must  be  organized  to 
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accept  inputs  concerning  private  medical  care  and  to  produce  outputs  for 
providers  and  carriers  dealing  with  private  medical  care.  In  brief,  PSRO's  must 
relate  to  and  have  data  concerning  the  entire  local  health  delivery  system  rather 
than  the  limited  subset  of  data  and  relationships  which  serve  Federal  beneficiaries. 

The  panel  recognized  two  distinct,  yet  related,  perspectives  for  the  collection 
of  review  data;  one  dealing  with  the  services  provided  to  a  specific  individual  and 
the  other  with  an  aggregate  describing  the  performance  of  a  provider  or 
institution  or  the  services  rendered  to  a  population. 

Review  of  individual  cases  is  the  classic  approach  to  medical  audit.  Individual 
case  review  is  also  the  classic  method  of  claims  review.  This  approach  has  the 
advantage  of  familiarity  and,  therefore,  greater  acceptance  when  properly 
performed.  The  disadvantage  of  this  approach  is  the  enormous  volume  of  work 
associated  with  the  review  of  a  sample  of  significant  size.  Current  efforts  have 
been  directed  towards  simplification  of  review,  and  reduction  of  workloads,  by 
the  automated  comparison  of  voluminous  performance  data  with  explicit  criteria. 

Analysis  of  aggregated  data  is  the  classic  tool  of  epidemiology  and  health 
service  research,  but  is  less  familiar  and  less  convincing  to  the  average  physician. 
Nevertheless,  the  chronologic  aggregation  of  provider  data  in  the  form  of  patient 
and  physician  profiles  for  comparison  with  model  practice  patterns  is  gaining 
acceptance. 

Physicians  are  also  familiar  with  the  use  of  aggregate  institutional  data  to 
describe  general  or  disease  specific  admission  rates,  length  of  stay,  and  various 
mortality  or  morbidity  rates.  Unfortunately,  the  impact  derived  from  institutional 
comparisons,  by  these  indices,  is  often  minimized  by  the  assertion  or  the  reality 
of  unique  patient  mixes  or  special  service  populations  in  different  hospitals. 
Furthermore,  though  the  patients  admitted  to  each  institution  are  known  and 
catalogued,  the  population  at  risk,  from  which  they  were  drawn,  can  only  be 
estimated  in  most  cases. 

Aggregate  data  describing  the  health  services  received  by  specific  populations 
has  recently  been  popularized  by  prepaid  groups  where  the  population  at  risk  is 
known  and  services  per  100  members  can  be  reported.  These  reports  are 
inaccurate  to  the  degree  that  subscribers  seek  unreimbursed  services  outside  of  the 
plan.  Similar  reports,  but  with  less  sophisticated  detail,  are  generally  developed  by 
most  insurance  carriers  per  unit  of  population  enrolled.  These  reports  are  similarly 
limited  by  unreported  services  not  reimbursed  by  the  intermediary.  An  essentially 
similar  and  more  accurate  approach  can  also  be  applied  to  the  population  of  any 
geographic  area  if  the  service  data  from  all  the  health  providers  and  institutions 
are  collected  and  resorted  in  relation  to  some  population  characteristic.  These 
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usages  develop  what  has  been  called  "population  based"  data  as  distinct  from 
"institutional  based"  data.  "Population  based"  data  permit  a  comparison  of 
different  population  groups,  more  or  less  readily  adjusted  for  the  unique 
demographic  characteristics  of  each  population  group. 

Individual  case  review  and  the  review  of  aggregate  data  are  not  unrelated. 
Aggregate  data  is  always  developed  by  the  summation  of  individual  data.  Criteria 
for  individual  review  are  usually  derived,  at  least  in  part,  from  an  analysis  of 
aggregate  data. 

In  the  judgment  of  the  consulting  panel,  individual  case  review  and  each  of 
the  forms  of  aggregate  data  review  discussed  above,  have  pertinence  to  specific 
facets  of  PSRO  activity.  The  comparison  of  "population  based"  data,  properly 
adjusted  for  variance  in  the  populations,  serves  to  monitor  the  performance  of  a 
region  and  indicate  the  presence  of  specific  problems  within  the  region. 
"Institutional  based"  data  helps  to  identify  the  source  of  these  problems. 
Individual  case  review,  in  those  institutions,  helps  to  further  define  both  the 
source  and  the  nature  of  the  problem  and  may  also  serve  as  the  educational  tool 
to  correct  the  problem.  Aggregate  provider  data,  in  the  form  of  patient  and 
physician  profiles,  document  the  repetition  and  consequently  the  more  serious 
nature  of  a  problem. 

The  imphcations  of  these  panel  perceptions  will  become  obvious  in  the 
ensuing  pages.  Briefly,  the  organizational  requirements  for  PSRO  must  conform 
to  the  varied  data  needs  and  the  different  output  routes  implied  by  these 
perspectives  for  professional  review. 
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THE  CONTENT  OF  PEER  REVIEW 


Peer  review  is  a  means  to  apply  collective  professional  judgment  to  individual 
or  group  medical  performance.  The  absence  of  simple  criteria  to  measure  the 
benefits  of  medical  care,  and  the  technical  nature  of  medical  practice,  both 
emphasize  the  need  for  physician  judgment  to  assess  the  necessity,  appropriate- 
ness, and  quality  of  medical  services.  In  short,  peer  review  is  the  only  adequate 
and  professionally  acceptable  means  to  accomplish  a  socially  mandated  review  of 
medical  practice. 

Consultation  and  teaching  or  supervisory  rounds  are  the  oldest  and  simplest 
form  of  peer  review.  Such  one-to-one  review  is  generally  concurrent,  has  a 
formative  role  in  patient  care,  and  depends  upon  the  apphcation  of  implicit 
criteria  by  a  recognized  expert.  Within  hospitals,  the  responsibility  for  peer  review 
has  been  delegated  to  the  medical  staff,  a  particular  service,  its  chief,  or  a 
designated  committee.  Collectivity  has  enlarged  the  scope  of  review  and 
introduced  retrospective  methods  geared  to  prospective  educational  solutions. 
Nevertheless,  until  recently,  hospital  peer  review  has  also  depended  upon  the 
apphcation  of  implicit  criteria  by  recognized  experts. 

The  demands  of  large-scale  medical  care  appraisal,  however,  and  the  parallel 
shortage  of  physicians  for  evaluation  activities,  generate  new  requirements  for 
regional  peer  review. 

(1)  To  process  the  volume  of  work,  automated  screening  and  professional 
review  only  of  exceptions  become  necessary. 

(2)  To  permit  automation,  and  insure  uniformity,  it  becomes  necessary  to  I 

define  explicit  criteria  and  select  appropriate  cases  for  study.  ! 

I 

(3)  To  make  large-scale  regional  review  worthwhile,  it  becomes  necessary  to  j 
develop  appropriate  and  effective  educational  or  fiscal  outputs  which  j 
demonstrably  modify  future  physician  behavior.  I 

In  this  section  we  will  describe  the  components  of  such  large-scale  regional  j! 
peer  review.  Before  proceeding,  however,  attention  is  called  to  the  glossary  of 
selected  terms  which  appears  in  Appendix  B.  The  usages  specified  by  this  listing 
will  be  employed  in  the  following  discussion.  I 

I 

! 
I 
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A.  MAJOR  COMPONENTS  OF  PEER  REVIEW 

A  schematized  presentation  of  the  major  components  of  peer  review  is  given 
in  Figure  1 .  To  expedite  the  discussion,  these  activities  were  divided  into  inputs, 
process,  outputs,  and  evaluation.  No  single  existing  peer  review  program 
encompasses  all  of  the  activities  outlined  in  this  theoretical  schema. 

1.  Inputs 

The  major  inputs  required  for  large-scale  medical  care  appraisal  include  the 
development  of  explicit  criteria  and  the  selection  of  appropriate  cases  for  review. 

a.  Criteria 

Criteria  explicitly  identify  the  elements  of  medical  care  which  characterize 
quality  of  care  for  each  diagnosis  or  condition  studied.  Whether  criteria  are  met  or 
not,  in  an  individual  case,  measures  the  quality  of  the  care  rendered.  Criteria  are 
most  often  selected  normatively  by  consensus  among  local  professional  commit- 
tees and,  given  the  present  state-of-the-art,  dominantly  relate  to  the  processes  of 
medical  care.  Most  current  criteria  are  optimal,  describing  the  best  practical  care 
obtainable.  In  some  cases  minimal  criteria  have  been  used  to  instruct  non-profes- 
sional reviewers  in  the  selection  of  cases  for  which  professional  review  is 
mandatory. 

Norms  generally  specify  quantitative  levels  of  performance.  They  are  usually 
developed  empirically,  by  measuring  performance  in  a  stated  sample,  but  may  be 
modified  by  deliberative  judgment.  Norms,  commonly  in  use,  deal  with  length  of 
stay,  frequency  of  visits,  charges,  and  mortality  rates.  Selected  norms  may  be 
optimal,  average,  or  minimal  or  may  describe  the  frequency  distribution  of  a  given 
event  in  a  defined  sample.  Norms  have  been  developed  for  both  the  processes  and 
the  outcomes  of  medical  care. 

Standards  specify  the  degree  of  desired  conformity  between  actual  practice 
and  exphcit  criteria  or  norms.  Standards  may  alternately  be  set  by  measured 
compliance  in  a  stated  sample  (empiric)  or  by  deliberative  professional  judgment 
concerning  what  should  exist  (normative).  The  former  method  tends  to  emphasize 
average  standards  and  the  latter  optimal  standards.  In  most  cases,  both  methods 
are  used,  one  for  initial  selection  and  the  other  for  validation,  yielding  standards 
which  fall  between  average  and  optimal. 
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b.  Selection  of  the  Cases  for  Study 

The  application  of  peer  review  to  large-scale  medical  care  appraisal  usually 
requires  a  choice  between  in-depth  study  of  a  small,  selected  sample  and  more 
superficial  appraisal  of  a  larger  volume  of  care.  The  latter  approach  is  frequently 
constrained  by  the  availability  of  data  reporting  sufficient  information  concerning 
major  segments  of  health  care.  In  general,  screening  methods  are  used  on  a  large 
sample  and  deliberative  judgment  applied  to  a  limited  number  of  exceptions.  The 
choice  of  cases  for  screening  is  generally  determined  both  by  the  purpose  of  the 
study  and  by  the  availability  of  data. 

There  are  three  common  methods  to  select  cases  for  screening  and  a 
significant  number  of  variations  employing  mixtures  of  these  approaches.  Studies 
geared  to  educational  problem  identification  usually  sample  physicians  who 
would  be  the  recipients  of  the  educational  output.  The  sample  frame  may  include 
individual  physicians  or  groups  of  physicians  such  as  the  staff  of  a  hospital  or 
group  practice.  The  samples  are  often  voluntary,  but  could  be  chosen  at  random 
or  on  any  other  basis  consistent  with  the  purposes  of  the  study. 

Studies  geared  to  cost  containment  generally  review  the  beneficiaries  of  a 
specific  intermediary  or  funding  program.  The  samples  may  include  persons 
eligible  for  Medicare  or  Medicaid,  all  or  a  subset  of  Blue  Cross  subscribers,  or  the 
patients  enrolled  in  a  specific  HMO.  As  with  educational  outputs,  this  selection  of 
cases  for  study  relates  to  the  means  by  which  peer  review  seeks  to  impact  on  the 
delivery  of  medical  care. 

Assuming  the  validity  of  the  methods  and  the  accuracy  of  the  data,  each  of 
these  two  methods  properly  defines  a  stated  sample.  Difficulties,  relating  to  the 
sampling  frame,  often  occur  when  these  results  are  extrapolated  to  other  groups 
or  populations.  A  third  approach  to  sampling  seeks  to  avoid  this  problem  by 
selecting  cases  from  a  representative  population. 

2.  Process 

The  process  of  peer  review,  in  large-scale  medical  care  appraisal,  involves  the 
application  of  a  screening  audit,  professional  judgment  for  a  limited  number  of 
exceptions,  and  a  formally  defined  route  for  appeal. 

a.  Screening  Audit 

The  screening  audit  compares  information  which  describes  practice  in  the 
sample  of  study  cases  with  explicit  criteria  and/or  norms,  previously  developed. 
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Its  purpose  is  to  identify  a  more  limited  subset  of  exceptions  to  established 
standards  or  to  statistically  evaluate  physician  compliance  with  explicit  criteria 
and  physician  performance  in  relation  to  explicit  norms. 

Screening  may  be  performed  manually  by  trained  reviewers,  or  automatically 
by  computers.  The  former  approach  tends  to  be  more  expensive,  takes  more  time 
thus  delaying  or  limiting  the  review,  and  introduces  some  lack  of  uniformity  into 
the  review.  While  the  automated  approach  solves  many  of  these  problems,  it 
introduces  rigidities  into  the  review  and  may  hmit  the  depth  of  the  review. 

The  major  problems  of  most  screening  audits  relate  to  the  source,  depth,  and 
accuracy  of  data  describing  practice  in  the  study  cases.  Such  difficulties  often 
dominate  the  selection  of  cases  for  study.  The  methodology  for  most  current 
screening  audits  calls  for  the  collection  of  summary  data;  reseaich  to  collect  and 
store  more  nearly  total  performance  data  is  now  underway.  Alternately,  the 
screening  audit  may  only  require  the  collection  of  abstracts  which  measure 
compliance  with  explicit  criteria  or  norms.  In  the  latter  case,  the  first  step  of  the 
screening  audit  is  performed  during  the  collection  of  the  data. 

Since  the  significance  of  peer  review  depends  upon  the  accuracy  of  the 
screening  audit,  most  methods  incorporate  some  means  to  check  the  reliability  of 
the  collected  data  base. 

b.  Professional  Judgment 

It  is  axiomatic,  in  medicine,  that  every  rule  has  justifiable  exceptions.  In  the 
interest  of  simplicity,  however,  a  screening  audit  includes  only  limited  abilities  to 
perceive  these  justifiable  variations.  It  follows,  then,  that  some  or  many  of  the 
exceptions  detected  by  screening  may  be  justified;  and  that  professional  judgment 
is  necessary  to  detect  the  subset  of  unjustified  exceptions. 

In  most  programs,  the  exceptions  detected  by  non-professionals  or  com- 
puters, are  reviewed  by  a  medical  advisor,  a  specialty  panel,  or  a  representative 
committee  or  board  of  physicians.  Many  programs  use  all  three  levels  of  review 
sequentially  depending  upon  the  complexity  of  the  problem.  In  some  cases  the 
professional  level  of.  review  is  not  conducted  by  the  staff  of  the  agency  detecting 
the  exception  but  by  the  staff  of  the  hospital  or  group  to  which  the  exception  is 
reported. 

I, 
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c.  Appeals 


Clearly,  the  final  determinations  of  peer  review  depend  upon  the  profes- 
sional judgment  exercised  by  physician  reviewers.  The  possibility  of  error  must  be 
admitted.  Despite  efforts  to  the  contrary,  inadequate  information  about  or 
inadequate  comprehension  of  a  specific  case  may  lead  to  erroneous  judgments. 

An  appropriate  appeal  mechanism  is  necessary  to  protect  both  patients  and 
physicians  against  the  consequences  of  erroneous  peer  review  judgments.  Most 
programs  provide  for  re-review  when  new  information  becomes  available  and  a 
special  route  of  appeal  to  a  specific  committee,  to  the  governing  body  of  the 
program,  or  to  the  local  or  state  medical  society. 

3.  Outputs 

The  outputs  of  peer  review  programs  may  be  used  for  educational  or 
non-educational  purposes.  Though  many  programs  emphasize  one  or  the  other, 
most  utilize  both  types  of  output,  to  some  degree. 

a.  Educational 

The  current  approach  to  physician  continuing  education  recommends:  (1) 
problem  identification;  (2)  analysis  of  its  causes;  (3)  a  search  for  solutions;  (4) 
implementation  of  the  solutions;  and  (5)  assessment  of  the  improvement.  The 
process  of  peer  review  identifies  those  physicians  with  educational  problems. 
Subsequent  peer  review  provides  an  opportunity  to  assess  their  educational  gain. 
The  intervening  educational  steps  may  be  accompHshed  on  an  individual  or  group 
basis. 

Reports  may  be  sent  to  individual  physicians  describing  their  level  of 
performance,  in  comparison  with  peer  groups,  or  giving  the  details  of  specific 
cases,  where  exceptions  to  accepted  criteria  or  norms  were  found.  These  reports, 
themselves,  may  provide  sufficient  education  to  modify  subsequent  behavior, 
depending  upon  the  physician's  professional  motivation  for  quahty  performance 
and  his  willingness  to  conform  to  group  standards. 

Frequently  common  problems  will  be  identified  in  many  physicians  who 
belong  to  a  single  hospital  staff  or  a  specific  medical  society.  This  situation 
presents  an  opportunity  for  group  meetings  to  analyze  the  problem  and  group 
education  to  seek  its  remedy. 

In  many  cases  the  educational  solution  will  not  be  found  in  further  training 
or  motivation  for  the  physician,  but  in  recognizing  systematic  constraints  on  the 
physician's  performance  and  in  making  appropriate  system  modifications  to 
eliminate  them. 
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b.  Non-Educational  Outputs 

The  non-educational  outputs  of  peer  review  include  a  variety  of  financial 
controls  over  the  reimbursement  process  and  a  variety  of  sanctions  which  regulate 
physician  activities.  Financial  controls  include  approval  (or  disapproval)  of 
payment  through  retrospective  claims  review,  and  prospective  or  continuing 
authorization  for  payment  through  precertification.  Sanctions  may  be  applied  at 
the  level  of  licensure,  hospital  privileges,  or  the  continued  ability  to  participate  in 
a  specific  reimbursement  program. 

4.  Evaluation 

Evaluation  of  peer  review  exists  on  at  least  two  levels;  one  internal  and  one 
external  to  each  program.  Internal  evaluation  involves  the  feedback  of  output 
data.  Closing  the  loop,  by  feedback,  permits  the  validation  or  modification  of 
future  criteria,  norms  and  standards  and  the  continued  selection  of  appropriate 
samples.  Continued  viability  and  the  acceptance  of  peer  review  depends  upon 
such  feedback. 

External  evaluation  measures  the  impact  of  peer  review  on  the  larger  regional 
health  delivery  system.  The  multiple  parameters  for  evaluation  include: 

•  Improved   physician   performance  (closer  comphance  with  criteria 
and/or  norms); 

•  Better  health  status  for  the  population  served; 

•  Greater  efficiency  of  the  health  delivery  system  (more  necessary 
services  per  unit  of  overall  cost); 

•  Program  benefits  versus  program  costs. 

B.APPROACHESTO  PEER  REVIEW 

This  section  addresses  the  practical  possibilities  for  the  application  of  peer 
review,  as  previously  described,  to  the  purposes  specified  by  P.L.  92-603.  To 
accomplish  this,  it  is  necessary  to  interrelate: 

( 1 )  The  objectives  of  the  legislation ; 

(2)  The  setting  for  review   (hospital,  nursing  home,  ambulatory,  and 
regional); 
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(3)  The  perspective  for  evaluation  (administrative,  professional,  patient,  and 
epidemiologic); 

(4)  The  chronology  of  review  (prospective,  concurrent,  or  retrospective); 
and 

(5)  The  content  of  review  (medical  process,  or  medical  outcomes). 

Table  I  interrelates  these  diverse  considerations  and  selects  specific  review 
programs,  which  in  our  opinion,  offer  practical  approaches  to  medical  care 
appraisal  on  a  regional  basis.  A  textual  explication  for  these  selections  follows. 

P.L.  92-603  mandates  a  regional  review  of  institutional  care,  by  prospective, 
concurrent,  and  retrospective  methods,  with  an  implied  concern  for  optimal 
regional  utilization.  The  necessity  for  and  duration  of  institutional  care,  the  use  of 
an  appropriate  institution,  and  the  provision  of  adequate  and  relevant  services  are 
specifically  included.  Comparable  audit  for  ambulatory  care  is  optional.  Table  I 
relates  these  objectives  to  each  setting  of  care. 

Since  a  review  of  the  necessity  for  hospital  admission  evaluates  institutional 
use,  level  of  care  was  not  listed  as  a  separate  objective.  While  the  legislation 
excludes  consideration  of  usual  and  customary  fees,  it  clearly  implies  concern  for 
the  proper  utilization  of  institutional  services  and  the  costs  they  generate. 
Hospital  services  and  costs  are  therefore  included.  The  duration  of  care  in  nursing 
homes  is  pertinent  only  to  the  special  subset  of  Skilled  Nursing  Homes.  In  most 
other  cases,  admission  is  for  the  balance  of  life.  The  level  of  care  in  nursing 
homes,  however,  is  a  dominant  consideration  and  has  been  separately  listed.  The 
objectives  for  ambulatory  care  reviews  are  practically  limited  to  the  frequency, 
quality,  and  volume  of  service. 

Table  I  also  introduces  other  perspectives  for  evaluation.  The  objectives 
described  above  for  hospitals,  nursing  homes,  and  ambulatory  care  are  generally 
perceived  from  an  administrative  or  professional  viewpoint.  It  is  equally  valid, 
however,  to  consider  the  viewpoint  of  the  individual  patient  or  an  epidemiologic 
viewpoint  with  concern  for  specific  populations. 

Table  I  provides  for  programs  to  appraise  both  the  processes  and  the 
outcorhes  of  medical  care,  following  the  terminology  provided  by  the  glossary  of 
terms  in  Appendix  B.  For  each,  prospective,  concurrent,  and  retrospective 
approaches  were  considered. 
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TABLE  I 


POTENTIAL  APPROACHES  TO  MEDICAL  CARE  APPRAISAL 
(Practical  Approaches  =  X) 
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The  necessity  for  hospital  admission  can  be  evaluated  by  accepted  process 
criteria  prospectively,  concurrently,  and  retrospectively.  It  may  also  be  evaluated 
against  patient  outcomes  at  the  time  of  discharge  or  subsequent  to  discharge. 
These  latter  studies,  by  definition,  need  to  be  retrospective.  The  duration  of  care 
(LOS)  has  been  treated  as  an  administrative  outcome,  consistent  with  the 
definitions  presented  in  the  glossary.  It  has,  and  can  be,  estimated  prospectively 
and  evaluated  concurrently  or  retrospectively  by  empiric  norms.  The  quality  of 
hospital  care  can  only  be  evaluated  during  or  after  the  fact.  The  quahty  of 
hospital  care  has  been  evaluated  concurrently  or  retrospectively  by  process 
standards,  and  for  certain  conditions  (such  as  surgical  procedures  and  frequently 
fatal  diseases)  by  measurable  intermediate  or  final  patient  outcomes.  Specific 
hospital  services  and  costs  have  been  treated  as  administrative  outcomes, 
consistent  with  the  definitions  given  in  the  glossary.  They  may  be  estimated 
prospectively  and  evaluated  concurrently  or  retrospectively.  Standards  for  this 
evaluation  will  depend  upon  the  prior  experience  of  the  institution  or  composite 
averages  from  comparable  institutions. 

Nursing  home  evaluations  differ  significantly  from  hospital  reviews.  There  is 
often  inadequate  information  for  prospective  review,  and  retrospective  studies  are 
markedly  limited  by  infrequent  discharges  occurring  only  with  death.  Further- 
more, the  primary  consideration  is  not  the  necessity  for  or  duration  of  care,  as  in 
hospitals,  but  rather  the  use  of  an  appropriate  level  of  care.  For  these  reasons  we 
have  emphasized  evaluation  of  the  level,  quality  and  content  of  care  provided  in 
nursing  homes  at  the  time  of  admission  and  concurrently  throughout  the  stay. 

The  level  and  quality  of  care  provided  may  be  measured  by  both  process 
criteria  and  outcome  standards.  Both  may  be  studied  concurrently;  the  former 
may  also  be  estimated  prospectively.  The  content  of  care  (services  and  costs)  is, 
by  definition,  an  administrative  outcome  which  should  be  evaluated  concurrently 
for  maximum  impact.  The  duration  of  care,  in  the  special  subset  of  Skilled 
Nursing  Homes,  is  also  an  administrative  outcome  which,  because  of  higher  cost, 
should  be  estimated  prospectively  and  evaluated  both  concurrently  and  retro- 
spectively. 

Excepting  a  limited  number  of  catastrophic  conditions,  ambulatory  services 
are  of  brief  duration.  This  fact  necessitates  evaluation  by  retrospective  methods. 
Volumetric  descriptions,  including  the  frequency  and  type  of  service,  as  well  as 
cost,  have  been  treated  as  administrative  outcomes  consistent  with  the  definitions 
given.  The  quality  of  ambulatory  care  may  be  evaluated  by  process  criteria,  and  in 
selected  conditions,  by  measurable  intermediate  patient  outcomes. 

Table  I  suggests  the  practical  measurement  of  patient  satisfaction  by 
retrospective  methods.  Patient  satisfaction  may  be  considered  a  process  outcome, 
consistent   with   glossary   definitions,   and   measured  by  such  indicators  as 
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compliance  with  medical  regimens,  increased  knowledge  of  disease,  rate  of  return, 
and  direct  opinion  gathered  by  survey.  The  table  also  suggests  process  studies  to 
measure  the  manner  by  which  patients  utilize  the  health  delivery  system  such  as 
inappropriate  use  of  emergency  rooms.  These  studies  require  the  development  of 
patient  profiles  describing  their  use  of  care,  longitudinally. 

Epidemiologic  studies  of  the  health  delivery  system  almost  always  require 
the  collation  of  multiple  provider  reports  to  develop  population-based  data  for 
hnkage  with  other  bodies  of  health  status  data.  These  evaluations  are  dependent 
upon  the  completion  of  service  and  are,  of  necessity,  retrospective  in  nature.  The 
volumes  of  care  delivered  and  both  services  and  costs  have  been  treated  as 
administrative  outcomes.  Mortality  and  morbidity  rates  are  prime  measures  of 
patient  outcomes. 
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THE  APPLICATION  OF  PEER  REVIEW  TO  PSRO 


Prior  sections  dealt,  in  turn,  with  the  provisions  of  P.L.  92-603  and  with  the 
content  of  peer  review.  This  section  integrates  these  considerations  in  an  attempt 
to  construct  a  functional  model  for  PSRO  activities. 

The  legislation  specifically  mandates  the  delegated  use  of  hospital  utilization 
review  committees  and  of  organized  group  practices  to  conduct  reviews,  providing 
they  demonstrate  their  capacity  to  the  satisfaction  of  the  PSRO.  There  is  an 
inherent  economy  in  avoiding  dupHcation,  and  a  programmatic  realism  in  bringing 
the  locus  of  review  as  close  as  possible  to  the  level  of  operations.  For  these 
reasons,  the  PSRO  will  need  to  delegate  the  responsibihty  for  many  review 
programs  and  develop  adequate  means  to  assure  that  the  programs  are  properly 
conducted. 

The  legislation  specifically  mandates  precertification  and  both  concurrent 
and  retrospective  audits,  for  all  institutional  services  provided  by  the  Social 
Security  Act,  to  assure  the  necessity,  appropriateness,  and  quality  of  the  care. 
Review  of  ambulatory  care  is  optional.  We  are  concerned  with  the  possibility  that 
efforts  to  meet  these  global  requirements  may  expend  greater  resources  on  review 
than  the  resultant  gain  in  health  service  efficiency  or  the  quahty  of  care.  The 
reality  of  this  possibility  has  been  demonstrated  recently  by  an  audit  of  the  HASP 
precertification  program  in  Illinois' .  To  avoid  this  possibility,  we  strongly 
recommend  that  the  specific  programs  of  review,  conducted  by  each  PSRO,  be 
carefully  related  to  the  needs  and  resources  of  each  designated  area.  An 
opportunity  for  less  than  complete  function  during  the  "conditional  contract" 
period  is  provided  by  the  legislation. 

In  the  further  interest  of  economy,  we  believe  that  each  PSRO  should  be 
equipped  with  a  macroscopic  overview  of  the  health  services  delivered  in  its 
designated  area.  We  believe  that  regional  studies  of  health  services  delivery  can 
efficiently  monitor  satisfactory  function  and  both  identify  and  locate  the  source 
of  specific  problems.  Given  the  identification  of  a  specific  problem,  an 
expenditure  of  greater  resources  is  warranted  to  determine  both  its  cause  and  its 
solution. 

To  satisfy  these  various  constraints,  with  the  tools  available  to  peer  review, 
we  believe  that  each  PSRO  will  need  to  incorporate  the  following  five  basic 
functions: 


'Report on  the  Hospital  Admission  and  Surveillance  Program  (HASP)  Hospital  Week,  Vol.  8, 
No.  39,  September  29,  1972. 
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( 1 )  Standard  setting  and  the  selection  of  cases  for  study; 

(2)  Regional  monitoring  of  health  delivery  indices; 

(3)  Review  of  delegated  responsibilities; 

(4)  Operation  of  undelegated  programs;  and 

(5)  Study  of  consumer  satisfaction. 

A  schema  describing  these  functions  in  relation  to  the  hospitals,  nursing 
homes,  physicians,  and  the  population  of  each  designated  area  is  presented  in 
Figure  2.  The  schema  was  designed  to  incorporate  all  of  the  activities  previously 
discussed  in  this  report.  We  recognize  that  most  conditional  PSRO's  will  activate 
only  part  of  this  functional  schema.  Textual  explication  of  these  activities  follows 
the  schema. 

A.  STANDARD  SETTING  AND  CASE  SELECTION 

Each  PSRO  will  need  to  develop  regional  criteria  for  quality  of  care,  norms 
for  the  frequency  and  duration  of  service,  and  standards  for  desired  compliance 
within  its  designated  area.  Criteria  and  standards  will  be  developed  by  local 
professional  consensus;  norms  will  be  derived  from  local  data.  They  will  be 
reviewed  by  the  National  PSRO  Council.  Justification  will  be  required  for  any 
significant  deviations  from  national  criteria,  norms,  and  standards. 

The  PSRO  will  need  to  select  the  cases  to  be  reviewed  in  each  functional 
element  of  the  program.  In  part  this  selection  is  dictated  by  law.  Review  of 
institutional  services  provided  by  the  Social  Secuiity  Act  is  mandatory;  review  of 
ambulatory  services  provided  under  the  Act  are  optional;  review  of  the  private 
health  care  sector  is  not  covered  by  the  legislation.  Nevertheless,  many  PSRO's 
will  probably  extend  their  reviews  to  the  private  sector  in  much  the  same  way 
that  Medicare-mandated  Utilization  Reviews  are  often  apphed  to  all  hospital 
patients. 

The  PSRO  will  therefore  need  to  develop  voluntary,  cooperative  arrange- 
ments with  physicians,  hospitals,  and  intermediaries  to  enable  the  review  of 
non-mandated  (private  sector)  and  optional  (ambulatory)  services.  The  PSRO  will 
also  be  required  to  periodically  select  specific  diagnostic  categories,  or  other 
classes  of  patients,  for  the  detailed  sample  review  of  mandated  services 
(institutional  care  under  the  Social  Security  Act). 
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Criteria,  Norms,  Standards  —  Selection  of  Cases  for  Study 
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FIGURE  2    PSRO  FUNCTIONS 
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B.  REGIONAL  MONITORING 


The  PSRO  will  need  to  monitor  both  the  costs  and  the  utilization  of  all 
institutional  health'  care  for  the  population  served.  It  will  monitor  component 
costs  and  utihzation,  attributed  to  different  levels  of  care  and  to  different 
common  discharge  diagnoses.  The  PSRO  should  study  the  distribution  of  various 
common  institutional  diagnoses  and  the  outcomes  of  regional  care  as  described  by 
vital  statistics.  Should  it  so  choose,  the  PSRO  may  collect  similar  data  for 
ambulatory  care,  but  will  be  limited  initially  to  reports  concerning  the 
beneficiaries  of  funded  ambulatory  programs,  outpatient  departments,  and  those 
enrolled  in  prepaid  practice. 

To  accomplish  these  goals,  the  PSRO  will  need  to  receive  the  data  described 
in  the  Uniform  Hospital  Discharge  Data  Set''^  from  a  regional  Hospital  Abstract 
System  and  from  a  regional  Nursing  Home  Reporting  System.  Other  significant 
input  information  should  include  the  demography  of  the  regional  population, 
from  census  data;  regional  vital  statistics  from  the  local  public  health  department, 
and  facilities  data  from  the  regional  health  planning  agency.  Data  partially 
describing  ambulatory  care  can  be  provided  by  the  accumulation  of  claims  and 
encounter  forms. 

C.  REVIEW  OF  DELEGATED  RESPONSIBILITIES 

The  PSRO  will  need  to  delegate  the  responsibihty  for  Precertification, 
On-Site  Concurrent  Review,  Hospital  Discharge  Auditing,  Nursing  Home  Evalua- 
tion, and  the  optional  review  of  ambulatory  care  to  those  institutions  which 
satisfactorily  demonstrate  their  capacity  to  perform  these  reviews.  Where 
practical,  the  PSRO  may  encourage  small  hospitals  to  share  their  resources  for  the 
conduct  of  these  programs  or  to  develop  working  relationships  with  larger 
institutions  for  the  same  purpose. 

There  are  two  ways  by  which  the  PSRO  can  assure  itself  that  these  reviews 
are  being  conducted  in  a  satisfactory  manner: 

(1)  Each  institution  with  delegated  responsibilities  will  report  its  methods 
and  data  describing  the  process  of  its  reviews  to  the  PSRO. 

(2)  Regional  monitoring  will  provide  the  PSRO  with  evidence  of  the 
successful  (or  unsuccessful)  impact  of  the  institution's  review  program. 


^Uniform  Hospital  Discharge  Data,  Health  Services  Foundation,  Government  Printing  Office, 

Publication  No.  (HSM)  72-3025,  1972,  21  pp. 
"^Common  Data  Set  for  Hospital  Management,  Hospital  Research  &  Educational  Trust, 

Government  Printing  Office,  Publication  No.  (HSM)  72-3026,  45  pp. 
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D.  OPERATION  OF  UNDELEGATED  PROGRAMS 


There  will  undoubtedly  be  a  number  of  institutions  in  each  area  which  are 
unable  to  conduct  their  own  effective  review  program.  Others  Vv'ill  be  unwilling  to 
assume  this  responsibility  and  still  others  will  have  failed  in  the  performance  of 
this  delegated  duty.  For  all  of  these  institutions,  and  for  most  of  ambulatory  care, 
where  few  institutional  intermediaries  exist,  the  PSRO  will  need  to  operate  its 
own  review  programs.  These  should  include: 

(1)  Precertification  for  hospital  services, 

(2)  On-Site  Concurrent  Hospital  Reviev^, 

(3)  Hospital  Discharge  Audits, 

(4)  Prospective  and  concurrent  nursing  home  evaluation,  and 

(5)  Retrospective  review  of  ambulatory  care. 

E.  STUDY  OF  CONSUMER  SATISFACTION 

The  PSRO  should  conduct  or  commission  sample  studies  of  consumer 
satisfaction  by  survey,  evaluate  patient  gain  in  understanding  of  disease,  study 
compliance  with  medical  regimens,  and  measures  of  the  rate  of  return  for  service. 
The  PSRO  should  develop  mechanisms  of  public  accountabihty  to  the  population 
of  its  designated  area  including,  but  not  limited  to,  public  reports  and  the 
evaluation  of  recurring  patient  complaints. 

By  the  apphcation  of  considerable  skill,  PSRO's  will  have  the  opportunity  to 
coordinate  these  five  areas  of  function;  to  relate  multiple  institutions  and 
agencies;  and  to  integrate  various  bodies  of  discrete,  though  related,  data.  These 
linkages  could  permit  more  effective  review  of: 

•  Prospective,  concurrent  and  retrospective  hospital  care  from  admission 
through  discharge; 

•  Related  systems  of  health  care  including  hospitals,  nursing  homes,  and 
ambulatory  care; 

•  Interrelations  and  overlaps  between  the  private  and  public  health  care 
sectors;  and 

•  Effects  of  the  health  delivery  system  on  the  population  at  risk. 
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We  believe  that  the  complete  requirements  of  P.L.  92-603  exceed  the 
capabilities  of  the  current  state-of-the-art  of  medical  care  appraisal  and  the 
resources  of  most  areas.  While  planning  for  full  functional  implementation,  most 
PSRO's  will  have  to  carefully  select  specific  programs  for  early  implementation. 
Care  will  be  required  to  relate  these  choices  to  the  needs  and  resources  of  each 
designated  area. 

In  our  opinion,  there  is  a  certain  set  of  functions  which  provide  the  critical 
mass  necessary  for  continued  PSRO  growth.  This,  however,  should  not  preclude 
more  mature  organizations,  such  as  EMCRO's,  or  existing  Foundations,  from 
implementing  other  established  programs.  Any  number  of  additional  programs, 
including  full  functional  implementation  of  all  PSRO  functions,  should  be 
considered  when  possible. 

The  minimal  functional  set,  as  well  as  subsequent  priority  considerations  are 
suggested  below: 

Minimum  Set  of  Functions 

•  Regioiial  Hospital  Abstract  System 

•  Retrospective  Hospital  Audit 

•  Appeals 

Programs  for  Early  Implementation 

•  Precertification  for  Hospital  Admission 

•  On-Site  Concurrent  Hospital  Review 

•  Precertification  and  Recertification  of  Nursing  Home  Care  in  relation  to 
Submitted  Treatment  Plans. 

Each  PSRO  needs  the  nucleus  of  a  Regional  Monitoring  System  in  order  to 
have  the  critical  m^ss  to  enable  further  growth.  The  current  state-of-the-art  will 
not  permit  rapid  implementation  of  Nursing  Home  Data  Systems,  but  Regional 
Hospital  Abstract  Systems  could  be  rapidly  implemented  throughout  the  nation. 
Given  this  data  source,  each  PSRO  could  conduct  retrospective  audits  by  the 
simple  addition  of  local  criteria.  An  adequate  appeal  mechanism,  as  part  of  a 
minimal  set  of  functions,  does  not  require  justification. 
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Regional  Hospital  Abstract  Systems  could  be  rapidly  developed  by  subscrib- 
ing to  existing  systems  such  as  PAS,  QUEST,  CUPIS,  HUP,  and  HDS,  or  by  the 
purchase  of  software  packages  from  such  existing  systems.  Blue  Cross  of 
Northeast  Ohio  was  able  to  implement  its  QUEST  system  in  six  (6)  Cincinnati 
hospitals  within  three  months.  The  modest  operating  costs  of  these  systems 
($0.40—0.75  per  discharge)  is  an  allowable  cost  under  most  public  and  private 
reimbursement  formulae  and  participation  in  such  data  systems  is  now  urged  by 
Blue  Cross.  The  initial  cost  of  purchasing  existing  software  for  a  new  system  is 
modest  (estimated  at  $1—2,000).  Furthermore,  some  of  these  systems  were 
developed  with  the  support  of  Federal  grants.  This  investment  can  now  provide  a 
dividend  in  the  form  of  more  widespread  use. 

Three  additional  programs  are  listed  for  early  implementation.  Precertifica- 
tion  is  required  by  the  law,  and  on-site  concurrent  review  required  to  make 
precertification  effective.  Nursing  Home  review  is  required  by  the  law. 
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SPECIFIC  PEER  REVIEW  PROGRAMS 


The  criteria  and  methods  required  for  PSRO  have  been  mentioned  in  prior 
chapters  to  the  extent  necessary  to  define  various  approaches  to  peer  review.  This 
section  addresses  the  current  availability  of  guidelines,  specifying  their  present 
state  of  development,  necessary  modifications  or  extensions  of  existing  models, 
and  newly  needed  criteria,  methods,  or  data  processing  systems. 

To  enable  further  discussion,  we  have  decided  to  classify  both  existing 
guidelines  and  necessary  new  or  modified  guidehnes  in  relation  to  the  programs 
they  support.  Table  II  summarizes  existing  guidelines,  and  Table  III  necessary  new 
or  modified  guidelines,  required  for  the  programs  mentioned  earlier.  The 
discussion  which  follows  has  been  keyed  to  these  same  programs  of  peer  review. 

A.  HOSPITAL  REVIEW  PROGRAMS 

Age-specific  norms  for  length  of  hospital  stay  by  diagnosis,  modified  by  the 
presence  or  absence  of  surgery  and  compHcating  additional  diagnoses,  are  in 
common  use  in  many  areas  of  the  country.  At  the  present  time,  most  of  these 
norms  are  based  on  PAS  data  provided  by  the  Commission  on  Professional  and 
Hospital  Activities'.  These  data  are  available  for  the  entire  country  or  for  large 
regional  subdivisions  including  many  states. 

PAS  data  are  derived  from  a  sample  of  reporting  hospitals  throughout  the 
nation.  Though  the  sample  is  large,  it  tends  to  be  skewed  by  unequal  geographic 
distribution,  and  by  greater  representation  of  small,  non-teaching  hospitals 
outside  of  major  metropolitan  centers.  Furthermore,  the  attributes  by  which 
length  of  stay  are  subclassified  do  not  completely  satisfy  the  needs  of  many  areas 
where  the  data  is  used.  For  these  reasons  regional  hospital  data  systems,  such  as 
HUP^ ,  QUEST^ ,  and  CUPIS"^ ,  have  been  developed  in  many  areas  of  the  country. 
They  provide  more  nearly  total  hospital  reporting  for  their  designated  areas,  and 
develop  empiric  length  of  stay  norms  by  a  logic  more  relevant  to  their  local  use. 
Where  regional  hospital  data  systems  are  still  under  development,  or  in  the 
planning  stage,  it  is  common  to  use  regional  PAS  norms  while  gathering  regional 
data  for  the  later  determination  of  local  empiric  norms  for  length  of  stay. 


'Slee,  V.N.  Professional  Activity  Study.  Medical  Care,  Vol.  VIII,  No.  4,  Supplement; 
July-August  1970. 

^  Lewis,  P.M.  The  Hospital  Utilization  Project  of  Pennsylvania.  Medical  Care,  Vol.  VUL  No.  4, 

Supplement;  July-August,  1970. 
^Mannix,  J.R.  The  QUEST  Program  of  Northeast  Ohio.  Medical  Care,  Vol.  VllI,  No.  4, 

Supplement;  July-August,  1970. 

Thompson,  J.D.,  et  al.  Connecticut  Utilization  and  Patent  Information  System,  CUPIS.  New 
Haven:  Yale  University,  Department  of  Epidemiology  and  Public  Health,  1971  (unpublished). 
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TABLE  II 
EXISTING  GUIDELINES 


Program 


Precertification 


Target 

LOS  Necessity 
for  Admission 


Existing  Guidelines 


On-Site  Concurrent  LOS  Quality  of 
Review  Care 

Discharge  Abstract 


System 


LOS  Quality  of 
Care 


Prospective  Review     LOS  at  each 


of  Treatment  Plan 

Nursing  Home 
Data  System 

Chart  Audit  with 
License  Inspection 


level  of  care 

Level  of  Care 
Quality  of  Care 

To  validate 
Reporting 


Claims  or  Frequency 
Encounter  Review  Quality 


Patient  and 
Provider  Profiles 

Consumer 
Satisfaction 


Regional 
Monitoring 


Criteria 

Norms  for  LOS  by 
diagnosis  from 
national  or  regional 
data  systems. 

Local  normative 
criteria  for  quality 
of  care. 

Not  yet  available 
in  significant  detail 


Minimal  local 
criteria  and 
empiric  norms 


Model  practice 
patterns 
(San  Joaquin) 

Not  yet  available 


Longitudinal 
Quality 

Satisfaction 
Continued  Use 
Compliance 
Educational  Gain 

Program  Impact  Empiric 
On  Target  Comparisons 


Methods 

CHAP,  HAPP,  HASP 

OSCHUR  CONSERVE 
CHAP,  CHEC 

PAS  and  Existing 
Regional  Data  Systems 

Precertification 

(New  Mexico,  Georgia) 

Developing  Data 
System  (Georgia) 

None 

Examples  of  Auto- 
mated Claims  Review, 
Encounter  Abstracts, 
and  Encounter 
Reporting 

On-Line  Profiles 
(New  Mexico) 

Research  Techniques 


Epidemiologic 
Research  Techniques 
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TABLE  III 


REQUIRED  NEW  OR  MODIFIED  GUIDELINES 


Program 


Precertification 


On-Site  Concurrent 
Review 

Discharge  Abstract 
System 


Prospective  Review 
of  Treatment  Plan 

Nursing  Home 
Data  System 


Chart  Audit  with 
License  Inspection 

Claims  or 

Encounter 

Review 

Patient  and 
Provider  Profiles 

Consumer 
Satisfaction 


Regional 
Monitoring 


Target 

LOS  Necessity 
for  Admission 


LOS  Quality 
of  Care 

LOS  Quality 
of  Care 


LOS  at  Each 
Level  of  Care 

Level  of  Care 
Quality  of  Care 


To  Validate 
Reporting 

Frequency 
Quality 


Longitudinal 
Quality 

Satisfaction 
Continued  Use 

Compliance 
Educational  Gain 


Program  Impact     Significance  of 
on  Target  regional  variation 


I — New  or  Modified  Guidelines  — 
Criteria  Methods 


Expand  and  refine 
regional  LOS  norms 
and  criteria  for 
admission 

Methods  for  case 
selection 

Expand  and  refine 
methods  for  excep- 
tion and  statistical 
reporting 

Criteria  for  review 
of  treatment  plans 

Normative  criteria  for 
level  and  quality  of 
care.  Standards  for 
anticipated  outcomes 

None 


Expand  and  refine 
norms  for  frequency 
of  visits  and  criteria 
for  quality  of  care 

Further  develop 
model  treatment 
plans 

Develop  Criteria 


Automated  Processing 


Replicate  and  extend 
current  programs 

Expand  and  refine 
regional  data  systems 


"Tie  in"  with  precer- 
tification programs 

Automate  comparison 
between  patient 
problems  and  services 
rendered 

"Tie  in"  with  state 
licensing  inspection 

Expand  and  refine 
central  collection  of 
claims  and  encounter 
forms 

Automate  application 
to  profiles 

Application  of 
Research  Techniques 


Application  of 
Research  Techniques 

Central  Reporting  by 
Data  Collection  Systems 
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The  common  analytic  approach,  in  all  of  these  data  systems,  is  the 
development  of  age  and  diagnosis  specific  frequency  distributions  for  length  of 
stay.  The  50th  percentile,  or  average  length  of  stay,  is  most  commonly  used  as  the 
norm;  in  some  instances  the  75th  or  even  the  90th  percentiles  are  accepted  as  an 
upper  limit.  Less  concern  has  been  evidenced  for  short  stays,  although  the 
approach  is  equally  appUcable  to  this  problem. 

Normative  criteria  for  quality  hospital  care,  by  diagnosis,  have  been  locally 
developed  in  many  areas  of  the  country.  They  are  generally  optimal,  process 

1  2 

criteria  patterned  after  the  work  of  Beverly  Payne.  •  Their  repetitive  develop- 
ment, in  different  areas  of  the  country,  has  been  accompanied  by  broader 
physician  involvement  in  criteria  generation,  and  by  the  newer  use  of  branching 
logic  to  account  for  contingencies  which  may  occur  during  the  natural  course  of 
disease  or  its  treatment. 

Explicit  criteria,  for  common  hospital  diseases,  describing  the  indications  for 
admission,  requirements  to  justify  the  discharge  diagnosis,  and  the  relevance  of 
tests  and  treatments  to  the  diagnosis,  are  now  available  from  the  work  of  Payne^, 
HUP* ,  the  Hennepin  County  Foundation^ ,  and  nearly  all  of  the  currently  funded 
EMCRO's. 

Criteria  for  quality  of  care  and  length  of  stay,  in  hospitals,  are  fully 
developed  and  ready  for  use.  Criteria  governing  the  quality  of  hospital  care  are 
available  for  over  60  percent  of  all  admissions;  criteria  governing  length  of  stay  are 
now  available  for  over  75  percent  of  all  hospital  admissions. 

1 .  Precertif ication 

Precertification  is  most  appropriate  for  elective  hospital  admissions,  but  has 
been  required  for  the  continuing  care  of  emergency  admissions  and  for  long  stays 
which  exceed  originally  anticipated  norms.  Well  known  precertification  programs 
now  exist  in  Sacramento  (CHAP)^  Illinois  (HASP)^  and  New  Mexico  (HAPP)' 


^  Payne,  B.C.(ed).  Hospital  Utilization  Review  Manual .  Ann  Arbor,  The  University  of  Michigan, 
1968. 

^Payne,  B.C.  Use  of  the  Criteria  Approach  to  Measurement  of  Effectiveness  of  Hospital 

Utilization.  Journal  of  the  American  Medical  Association,  196,:  1066-8,  1966. 
3  Ibid. 

''Lewis,  P.M.,  op.  cit. 

^Quality  Review  Program  and  Prospective  Utilization  Program.  Work  in  progress.  Developed  by 

the  Foundation  for  Health  Care  Evaluation  of  the  Hennepin  County  Medical  Society. 
^Certified  Hospital  Admission  Program  (CHAP).  Work  in  progress.  Developed  by  the  Medical 

Care  Foundation  of  the  Sacramento  County  Medical  Society.  Third  Printing  —  July,  1971. 
"^Hospital  Admission  and  Surveillance  Program  (HASP).  Work  in  progress.  Developed  by  the 

Illinois  Foundation  for  Medical  Care  of  the  IlUnois  State  Medical  Society. 
^'Hospital  Admission  Precertification  Program  (HAPP).  Work  in  progress.  Developed  by  the 

New  Mexico  Foundation  for  Medical  Care  of  the  New  Mexico  Medical  Society. 
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Precertification  may  be  performed  by  individual  physicians,  using  varied  and 
implicit  criteria,  as  in  the  Medicare  program;  it  may  be  formalized  with  explicity 
critieria  and  delegated  to  hospital  utilization  review  committees;  or  it  may  be 
conducted  on  a  regional  basis  by  an  intermediary,  EMCRO,  or  PSRO.  Various 
combinations  of  these  approaches  are  also  possible. 

The  objective  of  precertification  is  to  control  the  volume  of  hospital  service 
by  specific  and  Hmited  prospective  authorization.  This  is  accomplished  in  two 
ways: 

(1)  By  reviewing  the  necessity  for  hospital  admission  against  implicit  or 
exphcit  criteria  describing  indications  for  admission  for  the  most 
common  diseases; 

(2)  By  prospective  authorization  for  a  length  of  stay  based  on  empiric, 
average  regional  or  national  experience  for  that  specific  disease. 

The  source  document  for  precertification  is  always  on  application  completed 
by  the  physician  proposing  to  provide  the  service.  The  application  is  usually 
processed  by  a  trained  reviewer,  backed  by  medical  consultants;  where  explicit 
criteria  have  been  developed,  however,  precertification  could  be  largely  auto- 
mated. 

Methods  for  manual  precertification  programs  have  been  developed  and  now 
exist  in  Sacramento  (CHAP),  New  Mexico  (HAPP),  and  Illinois  (HASP). 
Automation  of  one  component,  the  authorization  of  an  appropriate  length  of 
stay,  has  been  accomplished  by  New  Jersey  Blue  Cross.'  Given  explicit  criteria  for 
both  length  of  stay  and  the  necessity  for  admission,  and  a  properly  designed 
apphcation  form,  we  believe  that  precertification  for  both  functions  can  be 
completely  automated. - 

We  have  mentioned  the  availabihty  of  criteria  for  length  of  stay  and  quality 
of  care  (including  the  necessity  for  admission)  in  many  areas  of  the  country.  Each 
of  these  unique  efforts  has  built  upon  the  base  of  experience  gained  by  prior 
approaches.  Despite  the  general  similarity  of  the  criteria  finally  developed,  few 
localities  appear  willing  to  wholly  accept  criteria  developed  elsewhere.  It  appears 
that  local  involvement  in  the  generation  of  criteria  is  necessary  for  acceptance. 
Recognizing  this  fact,  we  appreciate  and  recommend  the  continued  local 
development  of  criteria  for  the  quality  of  care  (including  the  necessity  for 
hospital  admission)  and  the  further  development  of  regional  hospital  data  systems 


'Bailey,  D.R.  and  Riedel,  D.C.,  Recertification  and  Length  of  Stay:  The  Impact  of  New 
Jersey 's  AID  Program  on  Patterns  of  Hospital  Care,  Blue  Cross  Reports,  6: 1-10.  July,  1968. 
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to  expand  and  refine  local  norms  for  length  of  stay.  Though  this  consideration 
requires  new  guideline  developments,  they  represent  an  extension  of  existing 
guideline  models  and  could  be  rapidly  developed  using  already  documented 
methods. 

The  value  of  precertification  programs  has  not  yet  been  fully  documented. 
The  admitting  diagnosis,  which  defines  the  needs  for  care,  may  be  hypothetical  in 
a  patient  who  presents  with  an  undiagnosed  problem.  Little  is  known  concerning 
the  effect  of  delays  introduced  by  precertification  and  possible  legal  habilities  for 
denying  admission.  Physicians  rapidly  learn  how  to  avoid  denials  of  precertifica- 
tion. Finally,  the  cost-to-benefit  ratio  for  precertification  in  the  HASP  program 
has  been  questioned  by  a  recent  audit' . 

The  New  Jersey  Blue  Cross  experience  with  precertification,  carefully 
analyzed  by  Riedel^ ,  demonstrated  an  initial  decrease  in  length  of  stay  which  was 
not  maintained  over  time.  It  has  been  suggested  that  the  impact  of  precertifica- 
tion would  be  enhanced  by  continuing  On-Site  Concurrent  Hospital  Review. 

In  summary,  then,  precertification  programs  can  be  used  to  evaluate  both 
the  necessity  for  hospital  care  and  an  appropriate  length  of  stay.  They  are  most 
effective  when  re-enforced  by  simultaneous  On-Site  Concurrent  Hospital  Review. 
These  efforts  should: 

(1)  Emphasize  a  standard  list  of  the  most  common  admission  diagnoses; 
and 

(2)  Use  expHcit  criteria  and  automated  processing,  insofar  as  possible. 

Model  guidelines  for  length  of  stay  and  necessity  for  admission,  and  manual 
methods  for  precertification  now  exist.  There  is  an  additional  need  for: 

(1)  Expansion  and  refinement  of  local  criteria  describing  the  necessity  for 
admission; 

(2)  Expansion  and  refinement  of  regional  hospital  discharge  data  systems 
to  develop  average,  local  empiric  lengths  of  stay  by  diagnosis;  and 

(3)  Use  of  exphcit  criteria  with  appropriate  application  forms  to  develop 
fully  automated  precertification  programs. 


^Report  on  the  Hospital  Admission  and  Surveillance  Program  (HASP).  Hospital  Week,  Vol.  8, 
No.  39.  September  29,  1972. 
^BaUey,  D.R.  and  Riedel,  D.C.,  op.  cit. 
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2.  On-Site  Concurrent  Hospital  Review 

On-Site  Concurrent  Review  is  primarily  appropriate  to  hospital  settings  for 
two  reasons. 

(1)  The  logistics  of  providing  a  trained  reviewer  require  a  critical  mass  of 
providers  in  one  site  for  cost  justification. 

(2)  The  impact  of  this  approach  is  dependent  upon  the  support  of  an 
organized,  functioning,  and  effective  medical  staff. 

On-Site  Concurrent  Hospital  Review  limited  to  length  of  stay  is  now  being 
conducted  in  Georgia  (CHEC)'  and  Sacramento  (CHAP)^.  On-Site  Concurrent 
Review  for  both  utilization  and  the  quality  of  care  is  now  being  performed  in 
Utah  (OSCHUR)^  and  in  Multnomah  County,  Oregon  (CONSERVE)^. 

The  objectives  of  these  current  programs  variably  include: 

(1)  Assignment  of  a  diagnosis  specific  length  of  stay  with  appropriate 
modifications  resulting  from  continued  on-site  review  of  the  patient's 
changing  condition; 

(2)  Concurrent  review  of  the  necessity  for  hospitahzation,  appropriateness 
of  the  diagnosis,  relevance  of  the  investigation  and  treatment,  and  the 
quality  of  the  medical  record  by  a  trained  nurse  reviewer  supported  by 
the  hospital's  own  staff  mechanisms  and  committees; 

(3)  Use  of  the  nurse  reviewer  to  abstract  medical  records,  as  they  are 
completed,  for  retrospective  comparison  with  normative  process  criteria 
for  the  quality  of  care. 

Since  the  third  objective  can  be  accomplished  equally  well,  and  perhaps  less 
expensively,  by  the  records  librarian,  we  do  not  recommend  this  facet  of  the 
program . 


^Certified  Hospital  Extension  of  Care  (CHEC).  Work  in  progress.  Developed  by  the  Georgia 

Medical  Care  Foundation  of  the  Medical  Association  of  Georgia. 
'^Certified  Hospital  Admission  Program  (CHAP).  Work  in  progress.  Developed  by  The  Medical 

Care  Foundation  of  the  Sacramento  County  Medical  Society.  Third  Printing  —  July,  1971. 
^On-Site  Concurrent  Hospital  Utilization  Review  (OSCHUR).  Work  in  progress.  Developed  by 

the  Utah  Professional  Review  Organization  of  the  Utah  State  Medical  Association. 
^Concurrent  On-Site  Evaluation  and  Review  Effort  (CONSERVE).  Work  in  progress.  Developed 

by  the  Multnomah  Foundation  for  Medical  Care  and  the  Multnomah  Experimental  Care 

Review  Organization  of  the  Multnomah  County  Medical  Society  (Portland,  Oregon). 
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On-Site  Concurrent  Hospital  Review  is  exquisitely  dependent  upon  the  skill 
and  tact  of  the  nurse  reviewer  and  upon  the  strength  of  the  hospital  medical  staff 
organization  whose  participation  makes  this  a  peer  review  program.  It  offers  an 
opportunity  to  influence  the  quality  of  medical  care  while  it  is  being  delivered. 
Because  of  the  need  for  human  intervention,  this  approach  is  considerably  more 
expensive  than  automated  reviews.  Current  estimates  yield  costs  ranging  up  to 
$15  per  discharge. 

On-Site  Concurrent  Hospital  review  could  be  conducted  in  large  institutions, 
by  a  nurse  coordinator  employed  by  the  hospital  who  reports  to  the  hospital 
utilization  review  committee.  This  approach  has  been  implemented,  in  part,  by 
New  Mexico'  for  HAPP  participating  hospitals.  The  feasibihty  of  the  program  in 
small  institutions  will  depend  upon  the  use  of  a  single  nurse  coordinator  by 
multiple  hospitals  or  on  the  use  of  a  nurse  coordinator  for  multiple  functions  in  a 
single  small  hospital.  The  use  of  a  hospital  employee  to  reduce  hospital  utilization 
may  generate  a  conflict  of  interest;  resolution  may  depend  upon  a  reorientation 
of  current  hospital  objectives. 

On-Site  Concurrent  Hospital  Review,  itself,  cannot  be  automated.  Many 
opportunities  exist,  however,  for  mutual  support  between  this  program  and 
automated  programs  for  precertification  and  hospital  discharge  auditing. 

The  availability  of  norms  for  length  of  stay  and  criteria  for  quality  care  have 
already  been  discussed.  Further  development  of  quality  criteria  and  regional  data 
systems  to  develop  local  norms  for  length  of  stay  are  necessary. 

The  methodology  for  On-Site  Concurrent  Review  of  both  the  length  of  stay 
and  quality  of  care  has  been  developed,  documented,  and  demonstrated  in  Utah 
(OSCHUR)  and  in  Portland,  Oregon  (CONSERVE).  Methods  for  On-Site 
Concurrent  Review  of  length  of  stay,  alone,  have  been  demonstrated  in 
Sacramento  (CHAP)  and  in  Georgia  (CHEC).  These  methods  require  replication 
and  extension  to  other  sites  for  national  application. 

The  manpower  required  for  On-Site  Review  of  all  hospital  cases  would  be 
prohibitive.  Guidelines  will  need  to  be  developed  to  specify  the  sample  of  cases  to 
be  reviewed  by  the  program;  for  example,  all  long  stays  and  a  ±  10  percent  sample 
of  other  cases,  including  short  stays  and  a  changing  variety  of  selected  diagnoses. 
Sample  studies  would  be  geared  only  to  educational  outputs. 

In  summary  On-Site  Concurrent  Hospital  Review  can  be  conducted  by  nurse 
coordinators  (or  other  trained  personnel)  employed  by  the  hospital,  or  a  group  of 


^Hospital  Admission  Precertification  Program  (HAPP),  op.  cit. 
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small  hospitals,  reporting  to  the  hospital  utilization  review  committee,  with  the 
added  support  of  medical  advisors  on  the  hospital  staff.  These  efforts  should 
emphasize: 

(1)  Modification  of  authorized  length  of  stay,  in  relation  to  the  patient's 
changing  condition; 

(2)  Concurrent  review  of  quality  to  influence  care  while  it  is  being 
delivered. 

Guidelines  for  length  of  stay  and  quahty  of  care,  and  models  for  On-Site 
Concurrent  Hospital  Review,  are  now  available  in  selected  areas  of  the  country. 
There  is  an  additional  need  for: 

(1)  Expansion  and  refinement  of  local  criteria  and  norms; 

(2)  Replication  and  extension  of  current  program  models  for  On-Site 
Concurrent  Review  by  hospital-employed  nurse  coordinators,  reporting 
to  the  hospital  utilization  review  committee  and  supported  by  medical 
advisors  on  the  hospital  staff; 

(3)  Cooperation  between  small  hospitals  for  the  shared  use  of  nurse 
coordinators;  and 

(4)  The  development  of  guidelines  to  specify  the  cases  selected  for  On-Site 
Concurrent  Hospital  Review. 

3.  Discharge  Abstract  Systems 

Retrospective  medical  audits,  in  hospitals,  have  been  conducted  since  1914 
by  appropriate  committees  using  case  review  techniques  and  implicit  criteria. 
Since  the  advent  of  Medicare,  utilization  review  for  length  of  stay  has  been  added 
to  quahty  review  as  a  major  focus  for  these  activities. 

In  the  past  decade,  sophisticated  computer  techniques,  operated  by  national 
or  regional  programs,  have  helped  to  display  and  sort  the  material  for  review. 
Central  reporting  by  many  institutions  has  added  an  additional  dimension  to  the 
review;  namely,  the  opportunity  for  inter-hospital  comparison.  The  provisions  of 
P.L.  92-603  now  add  yet  another  dimension;  namely,  central  review  by  accepted 
regional  criteria. 

Available  hospital  data  collection  systems  depend  upon  the  information  in  a 
source  document  prepared  by  the  medical  records  librarian  at  the  time  of 
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discharge  or  when  the  record  is  completed.  The  amount  of  data  required  by  each 
system  is  variable,  but  a  minimum  set  of  basic  data  has  recently  been  established ' . 
Computer  processing  permits  various  displays  of  the  data,  statistical  summaries, 
and  the  development  of  managerial  indices.  These  data  permit  evaluatory 
comparisons  with  other  time  periods,  other  institutions  or  professionals,  and  with 
accepted  criteria  or  norms. 

Length  of  stay  is  commonly  evaluated  retrospectively  by  hospital  abstract 
systems.  This  evaluation  depends  upon: 

( 1 )  The  development  of  age  specific  empiric  norms  for  length  of  stay  by 
diagnosis,  (with  or  without  surgery,  and  with  or  without  multiple 
diagnoses)  from  a  large  number  of  national  or  regional  reporting 
institutions; 

(2)  The  comparison  of  each  hospital,  service,  or  physician  with  a 
comparable  universe  selected  in  accordance  with  specified  character- 
istics; and 

(3)  The  reporting  of  comparative  statistics,  or  exceptions  which  deviate 
from  these  norms,  for  more  intensive  hospital  review. 

The  quality  of  care  may  be  measured  by  the  relevance  of  procedures  and 
treatments  to  the  discharge  diagnosis.  Branched  logic  permits  evaluation  of 
various  contingent  possibilities.  Normative,  process  criteria  for  this  evaluation  are 
usually  structured  to  indicate: 

•  Investigations  and  treatments  recommended  for  each  common  diag- 
nosis, and 

•  Investigations  and  treatments  frequently  associated  with  each  common 
diagnosis. 

Investigational  procedures  and  treatments,  submitted  to  the  abstracting 
system,  may  be  reported  to  the  subscribing  hospital  in  the  form  of  a  statistical 
index,  such  as  the  percentage  of  patients  with  pneumonia  who  did  not  receive 
chest  X-rays,  or  as  an  exception  list  of  all  patients  with  pneumonia  who  did  not 
receive  chest  X-rays.  Exception  reporting  is,  by  far,  the  more  common  approach. 
Quality  exceptions  may  be  noted,  and  reported,  in  each  case  where  recommended 
investigations  and  procedures  were  not  done;  professional  review  may  indicate 
that  these  cases  represent  inadequate  care.  Similarly,  cases  may  be  noted,  and 
reported  as  exceptions,  when  procedures  and  treatments  were  performed  which 


*  Uniform  Hospital  Discharge  Data  and  Common  Data  Set  for  Hospital  Management,  op.  cit. 
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are  neither  recommended  nor  commonly  associated  with  the  diagnosis;  profes- 
sional review  may  indicate  that  these  cases  represent  excessive  or  inappropriate 
care.  When  using  explicit  quality  criteria,  care  must  be  exercised  to  avoid 
promoting  excessive  medical  care  designed  only  to  avoid  the  implication  of  under 
utilization. 

The  necessity  for  admission,  including  the  validity  of  the  discharge  diagnosis, 
may  be  studied  retrospectively  by  hospital  abstract  systems.  Available  criteria  for 
this  evaluation  usually  refer  to  the  content  of  the  admission  note,  or  the  initial 
history  and  physical  examination.  Special  training  is  required  for  records 
librarians  to  be  able  to  abstract  this  information  from  the  medical  record.  Since 
the  extra  effort,  and  cost,  may  not  be  worth  the  additional  gain,  and  since  this 
facet  of  evaluation  is  perhaps  better  performed  by  prospective  and  concurrent 
methods,  this  objective  for  discharge  abstracting  is  not  recommended. 

Data  concerning  outcomes,  other  than  the  condition  at  the  time  of 
discharge,  are  not  generally  available  to  hospital  abstract  systems,  which  are 
sharply  limited  by  the  lack  of  follow-up  information.  Therefore,  a  concentration 
on  outcome  evaluation  by  the  retrospective  methods  available  through  hospital 
abstract  systems  is  not  recommended. 

Criteria  for  length  of  stay  and  quahty  of  care  are  available  from  the  same 
sources  as  for  Precertification  and  On-Site  Concurrent  Review;  the  need  for 
extension  to  develop  new  local  criteria  in  each  review  site  remains  valid. 

Criteria  for  the  quality  of  care  are  slightly  more  complex  than  for  length  of 
stay  or  necessity  for  admission.  Quality  of  care  criteria  generally  specify  both 
tests  and  treatments  which  are  recommended  for  each  diagnosis,  and  those  which 
are  commonly  associated  with  each  diagnosis.  Deviation  from  these  brackets 
defines  inadequate  care,  on  the  low  side,  and  excessive  or  inappropriate  care,  on 
the  high  side.  Furthermore,  branching  logic  offers  the  opportunity  to  define 
criteria  not  only  for  a  specific  diagnosis,  but  for  contingent  possibilities  which 
may  occur  during  the  course  of  a  specific  disease.  The  bracketed  use  of 
recommended  and  appropriate  tests  and  treatments  and  the  application  of 
branching  logic  have  been  tried  and  developed  in  specific  areas  of  the  country.  As 
with  criteria,  in  general,  these  techniques  need  local  replication  in  each  new  area. 

Methods  for  discharge  abstracting  and  the  display  of  performance  summaries 
have  been  thoroughly  developed  by  CPHA'  for  its  PAS  system  and  by  regional 
systems  such  as  QUEST^,  HUP-',  and  CUPIS'*.  Each  of  these  systems  has 


'Slee,  V.N.,  op.cit. 
^Mannix,  J.R.,  op.  cit. 
^Lewis,  P.M.,  op.  cit. 
^Thompson,  J.D.,  et  a!.,  op.  cit. 


developed  statistical  indices  to  compare  each  hospital  with  a  comparable 
inter-hospital  universe.  Exception  reporting  after  comparison  with  explicit  disease 
specific,  process  criteria  is  a  more  recent  development  which  has  been 
demonstrated  in  Hawaii'  and  Mississippi^. 

The  relative  value  of  national  or  regional  hospital  abstract  systems  was 
considered.  Regional  systems  offer  several  specific  advantages,  which  promote 
better  acceptance,  including: 

•  Local  control, 

•  Locally  developed  criteria, 

•  Simplified  exception  reporting,  and 

•  Greater  responsiveness  to  local  needs. 

Hospital  Abstract  Systems  are  now  widely  used  to  support  peer  review 
activities.  Despite  laudable  goals,  they  have  been  accused  of  producing  a  vast 
amount  of  data  untouched  by  the  human  mind.  This  difficulty  may  be  obviated 
by  the  more  widespread  use  of  plain  English  exception  reports  and  by  the 
development  of  simple,  useful  statistical  indices.  Furthermore,  Discharge  Data 
Systems  are  entirely  dependent  upon  comparisons  with  discharge  diagnoses. 
Considerable  hospital  care  may  justifiably  relate  to  an  admitting  problem,  rather 
than  the  discharge  diagnosis  finally  developed. 

In  summary,  retrospective  hospital  audits  can  be  conducted  with  the  support 
of  regional  hospital  abstracting  systems.  They  should  emphasize: 

( 1 )  Evaluation  of  length  of  stay  by  empiric  regional  norms; 

(2)  Quality  of  care  determined  by  comparison  of  procedures  and  treat- 
ments with  regionally  accepted  process  criteria  and  some  intermediate 
outcomes; 

(3)  Contingent  branched  logic  to  study  quahty  of  care;  and 

(4)  Exception  rather  than  total  reporting. 


^Hawaii  Experimental  Medical  Care  Review  Organization  of  the  Hawaii  Medical  Association. 
Work  in  progress. 

'^Mississippi  Experimental  Medical  Care  Review  Organization  of  the  Mississippi  State  Medical 
Association.  Work  in  progress. 


43 


Arthur  D  Little,  Inc 


Necessity  for  admission,  the  validity  of  the  discharge  diagnosis,  and  most 
patient  outcomes,  are  better  evaluated  by  other  methods. 

The  basic  techniques  for  hospital  discharge  data  collection  now  exist,  and  are 
in  use  somewhere  in  the  nation.  Several,  however,  arc  new  enough,  or  not  yet 
widespread  enough,  to  necessitate  the  following  requirements  for  new  guidelines: 

(1)  Support  for  the  development  and  extension  of  regional  hospital 
abstract  systems  throughout  the  country; 

(2)  Further  refinement  in  the  technique  of  exception  reporting;  and 

(3)  The  design  of  new  indices  for  statistical  reporting. 

B.  NURSING  HOME  REVIEW  PROGRAMS 

Nursing  homes  are  now  reviewed  by  state  departments  of  health  and  by  the 
Joint  Commission  on  Accreditation  of  Hospitals.  These  reviews  are  designed  to 
certify  the  presence  of  an  adequate  structure,  staff,  and  organization  for  various 
levels  of  care.  In  some  states,  Medicaid  patients  must  be  precertified  for  an 
appropriate  level  of  care. 

Prospective  review  is  sometimes  difficult  in  the  nursing  home  setting,  since 
there  is  often  inadequate  information  concerning  the  patient  prior  to  admission. 
Furthermore,  long  stays  and  changes  in  the  patient's  status,  may  require  revision 
of  the  appropriate  level  of  care.  In  most  nursing  homes,  excluding  the  subset  of 
Skilled  Nursing  Homes,  patients  are  admitted  for  the  remainder  of  their  lives. 
Retrospective  review,  as  after  hospital  discharge,  would  be  limited  only  to  deaths 
and  would  occur  too  long  after  the  delivery  of  service  to  be  of  great  value. 

For  these  practical  reasons,  we  emphasize  the  importance  of  concurrent 
review  in  nursing  homes.  An  advanced  model  for  such  automated  review  is  now 
being  developed  by  the  Georgia  EMCRO'  which  began  implementation  during 
January,  1 973. 

Georgia  is  developing  a  source  document  to  be  reported  by  nursing  homes, 
for  each  patient,  within  thirty  days  of  admission,  at  subsequent  180-day  intervals, 
or  more  frequently  when  indicated  by  a  changing  or  unstable  patient  status.  The 
source  document  includes  the  information  needed  to  develop  a  problem 
statement  for  each  patient  such  as  diagnosis,  status  of  the  condition,  nursing  or 


^Nursing  Home  Dcta  System.  Work  in  progress.  Developed  by  the  Georgia  Experimental 
Medical  Care  Review  Organization  of  the  Medical  Association  of  Georgia. 
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other  treatment  requirements,  and  drug  needs,  as  well  as  functional  and 
behavioral  status.  The  source  document  also  includes  a  description  of  the  services 
actually  provided  to  each  patient.  Automated  filing  and  retrieval  of  this 
information  are  included. 

At  the  same  time,  the  Georgia  EMCRO  and  the  State  Nursing  Home 
Association  are  jointly  developing  explicit  criteria  for  the  automatic  comparison 
of  patient  problems  with  services  rendered.  By  this  means,  they  hope  to 
determine: 

•  Appropriateness  of  the  level  of  care, 

•  Appropriateness  of  specific  services  in  relation  to  patient  needs,  and  to 

•  Evaluate  changes  in  the  patient's  status. 

Their  criteria  are  largely  normative,  optimal,  and  process;  some  outcomes, 
however,  are  included  in  their  evaluation  of  changing  patient  status.  The  system  is 
still  in  its  design  stage  and  is  yet  to  be  fully  tested. 

The  Georgia  model  depends  upon  recurrent  monitoring  of  the  relevance  of 
services  to  patient  problems,  and  the  development  of  criteria  governing  this 
relationship.  This  is  essentially  comparable  to  the  development  and  use  of  criteria 
describing  quality  hospital  care  for  each  common  diagnosis.  Unfortunately,  the 
problem  statement  for  most  nursing  home  patients  is  more  complex  than  for 
hospital  patients  and  less  completely  described  by  the  diagnosis,  alone.  Additional 
parameters  are  necessary,  as  in  the  Georgia  model,  to  develop  an  adequate 
problem  statement  and  the  pertinent  criteria  for  relevant  care.  This  difficulty 
should  not  discourage,  but  will  probably  slow  the  full  development  and 
availability  of  the  Georgia  model. 

The  comparison  between  patient  needs  (problem  statement)  and  services 
rendered  can  also  be  approached  in  two  steps.  A  treatment  plan,  which  is  at  least 
theoretically  in  common  use,  relates  the  problem  statement  to  the  services 
required  by  each  patient.  Treatment  plans,  in  fact,  describe  the  criteria  of  care  for 
each  case  and  will  be  summarized  in  the  Georgia  criteria.  Pending  the  availability 
of  the  more  sophisticated  Georgia  model,  treatment  plans  could  be  required  by 
the  PSRO  prior  to  admission  and  at  selected  subsequent  intervals.  Sample  record 
audits,  during  regular  state  licensing  inspections  could  be  used  to  check  the 
validity  of  the  plans  and  their  implementation. 

The  state-of-the-art  of  nursing  home  evaluation  is  far  less  developed  than  the 
evaluation  of  hospital  care.  As  a  result,  there  are  greater  requirements  for  new 
criteria  and  methodologies. 
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1.  Prospective  Review  of  Treatment  Plans 

Criteria  will  be  needed  to  evaluate  the  relevance  and  the  implementation  of 
submitted  treatment  plans.  Methods  will  be  required  to  include  the  submission  of 
treatment  plans  in  existing  or  newly  required  precertification  programs. 

2.  Nursing  Home  Data  System 

Further  development  of  the  Georgia  model  will  be  needed,  it  will  be 
necessary  to  develop: 

•  A  uniform  base  of  patient  status  information  adequate  to  the 
development  of  a  patient  problem  statement; 

•  A  uniform  base  for  service  reporting  adequate  to  define  the  care 
delivered  to  each  patient; 

•  A  functional  classification  of  patients  permitting  the  storage  and 
retrieval  of  the  data  described  above. 

•  Normative  criteria  for  the  quality  of  care  and  appropriateness  of  the 
level  of  service;  empiric  norms  for  length  of  stay  at  each  level  of  care; 
and  standards  for  anticipated  outcomes. 

•  Automated  methods  for  the  storage  and  retrieval  of  patient  data  and 
for  comparison  with  explicit  criteria. 

3.  Chart  Audit  with  License  Inspection 

Both  guidelines  and  methods  will  be  required  to  conduct  sample  chart  audits 
during  the  regular  licensing  inspection  of  nursing  homes.  Initially  these  should  be 
geared  to  evaluate  the  validity  of  treatment  plans  and  to  gather  evidence  of  their 
implementation.  Subsequently,  chart  auditing  could  be  used  to  check  the  validity 
of  abstracts  reported  to  a  Nursing  Home  Data  System. 

Despite  emphasis  on  concurrent  nursing  home  evaluation,  we  appreciate  the 
desirability  of  initial  prospective  authorization  prior  to  admission.  We  also  appreci- 
ate the  need  for  length  of  stay  estimates  by  level  of  care,  and  total  stay  estimates 
for  the  special  subset  of  Skilled  Nursing  Homes,  which  have  a  more  transient 
population. 

In  summary,  prospective  and  concurrent  nursing  home  programs  can  be 
conducted  to  emphasize  a  review  of  the  appropriateness  of  care  (planned  or 
given)  in  relation  to  individual  patient  needs.  Prospective  authorization  for  length 
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of  stay  at  each  level  of  care  (including  total  stay  in  skilled  Nursing  Homes)  should 
be  provided.  Gradual  development  of  a  review  program,  taking  present  realities 
into  account,  is  possible: 

(a)  Initially,  prospective  submission  of  a  treatment  plan,  relative  to  the 
patient  needs,  prior  to  admission  and  at  stated  intervals  thereafter. 

(b)  Sample  record  audit,  in  conjunction  with  state  licensing  inspection,  to 
check  the  validity  of  the  treatment  plan  and  its  actual  use. 

(c)  Work  towards  the  development  of  a  functional,  rather  than  a 
diagnostic,  patient  classification  system  and  process  criteria  for  care 
partly  based  on  information  submitted  in  the  treatment  plans. 

(d)  Design  of  an  abstract  and  reporting  system  modeled  after  the  Georgia 
approach. 

(e)  Use  of  this  system  for  reimbursement  and  claims  review. 

(f)  Episodic  on-site  sample  audits  (in  conjunction  with  state  licensing 
review)  to  validate  data  submitted  to  the  reporting  system. 

Imphcit  methods  for  nursing  home  precertification,  some  expHcit  criteria 
governing  level  of  care,  and  early  designs  for  an  Automated  Nursing  Home  Data 
System  now  exist.  Many  new  guidelines  will  be  needed  for  nursing  home  review. 
There  is  a  need  for: 

(1)  Criteria  and  methods  to  review  treatment  plans  in  conjunction  with 
precertification  programs; 

(2)  A  functional  classification  of  nursing  home  patients; 

(3)  Design  and  implementation  of  a  Nursing  Home  Data  System  including 
patient  status  descriptors  (problem  statement),  care  descriptors  (service 
reports),  and  automated  comparison  with  explicit  criteria  (treatment 
plans). 

(4)  Guidelines  and  methods  for  sample  chart  audits  (during  state  hcensing 
review)  to  validate  reported  data. 

C.  CLAIMS  FORM  OR  ENCOUNTER  REVIEW  OF  AMBULATORY  SERVICES 

Auditing  the  quality  of  ambulatory  care  is  optional  under  P.L.  92-603.  If 
done,  it  need  be  retrospective,  arid  because  of  the  huge  volume  of  services,  must 
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be  automated.  The  major  difficulty  is  the  lack  of  an  adequate  source  document 
describing  the  content  of  ambulatory  services  in  sufficient  detail.  The  best  current 
approach  to  such  data  is  the  claims  form,  where  required,  and  the  encounter 
document,  where  it  is  now  in  use  or  can  be  initiated.  Practically,  this  limits 
ambulatory  review  to  the  beneficiaries  of  ambulatory  insurance  programs  or  those 
enrolled  in  prepaid  group  practice. 

Efforts  are  under  way  to  define  criteria  for  the  quality  of  ambulatory 
services.  For  reasons  of  simplicity,  and  to  minimize  the  need  for  new  data,  these 
efforts  have  concentrated  on: 

•  Frequency  of  visits  by  diagnosis  or  condition,  and 

•  Relevance  of  treatments  and  tests  to  the  diagnosis  or  condition. 

A  limited  number  of  normative  criteria  have  been  locally  developed,  in  a 
number  of  sites,  for  both  the  frequency  of  visits  and  the  relevance  of  tests  and 
treatments  to  a  number  of  common  ambulatory  conditions.  Minimal  criteria  have 
been  developed  in  New  Mexico'  to  serve  as  clerical  guidelines  for  non-professional 
reviewers,  to  aid  in  the  detection  of  Medicaid  cases  where  professional  review  is 
mandatory.  Optimal  criteria  for  automated  screening  of  ambulatory  care  have 
been  developed  in  Hawaii^  and  in  Utah-^. 

Criteria  have  been  developed  for  far  fewer  ambulatory  conditions  than  for 
hospital  diagnoses.  Empiric  norms  for  the  average  frequency  of  visits  by  condition 
have  not  been  developed  due  to  the  lack  of  adequate,  representative  data. 

A  major  problem  in  ambulatory  review  has  been  the  lack  of  an  adequate 
source  document  describing  the  care  rendered  in  relation  to  the  patient's 
problems.  The  correction  of  this  problem  has  been  approached  by  adding 
additional  items  to  claims  form  (New  Mexico,  Utah),  by  developing  an  office 
encounter  form  for  widespread  use  (Portland,  Oregon)^,  and  by  having  trained 
personnel  abstract  office  records  (Hawaii). 

Most  programs  studying  ambulatory  care  recognize  the  value  of  and 
encourage  the  use  of  problem-oriented  records.  Their  advantages  rest  on  the  fact 


^ New  Mexico  Ambulatory  Care  Program.  Work  in  progress.  Developed  by  the  New  Mexico 

Foundation  for  Medical  Care  of  the  New  Mexico  Medical  Society. 
'^Ambulatory  Program  of  the  Hawaii  EMCRO  sponsored  by  the  Hawaii  Medical  Association. 

Work  in  progress. 

^PACE.  Work  in  progress.  Developed  by  the  Utah  Professional  Review  Organization  of  the  Utah 

State  Medical  Association. 
^Multnomah  Foundation  for  Medical  Care  Ambulatory  Care  Program.  Work  in  progress. 

Developed  by  the  Multnomah  EMCRO  of  the  Multnomah  County  Medical  Society  (Portland, 

Oregon). 
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that  much  ambulatory  care  relates  to  patient  problems  prior  to  the  establishment 
of  a  proven  diagnosis.  Furthermore,  obligatory  reporting  of  ambulatory  tests  and 
treatments  in  relation  to  the  instigating  problem  would  significantly  clarify 
evaluation  when  multiple  problems  are  being  treated  or  studied.  An  alternative  to 
this  approach  would  be  the  identification  of  commonly  clustered  problems  and 
the  development  of  appropriate  criteria  for  the  entire  cluster. 

Clearly,  the  sophistication  of  ambulatory  review  lags  far  behind  hospital 
auditing.  Lack  of  a  source  document  for  reporting,  lack  of  centralized  reporting, 
lack  of  total  reporting,  and  a  dearth  of  appropriate  criteria  and  defined  outcomes 
have  all  contributed  to  the  tardy  development  of  ambulatory  audits. 

Nevertheless  the  methods  to  develop  normative  criteria  for  quahty  care  exist; 
the  means  are  present  to  generate  empiric  norms  for  the  frequency  of  visits  based 
on  adequate  reports  from  a  representative  population.  Such  criteria  and  norms 
will  need  to  be  newly  developed  in  multiple  areas  of  the  country.  The  effort 
required  is  not  likely  to  be  invested  until  more  adequate  ambulatory  reporting 
methods  are  available  which  make  productive  audits  possible.  These  developments 
will  not  occur  rapidly.  Nevertheless,  it  will  be  possible  for  PSRO's  to  store  as 
much  ambulatory  care  data  as  possible.  Despite  initial  inadequacies  this  will  be  a 
significant  step  towards  total  reporting  and  analysis  of  each  regional  health 
delivery  system. 

In  summary,  simple  audits  of  ambulatory  practice,  such  as  the  frequency  of 
visits  and  the  relevance  of  tests  and  treatments,  can  be  conducted  by  retrospective 
analysis  of  claims  forms  or  encounter  documents.  Both  will  require  abstracting 
and  automated  comparison  with  explicitly  developed  criteria.  The  frequent 
presence  of  problems  rather  than  diagnoses,  in  office  practice,  and  the  multiple 
problems  often  encountered,  can  be  approached  by: 

( 1 )  Encouraging  problem-oriented  records; 

(2)  Listing  tests  and  treatments  in  relation  to  specific  instigating  problems; 
or 

(3)  Cluster  analysis  of  commonly  associated  problems. 

A  number  of  local  criteria  and  norms  for  ambulatory  care  and  some 
examples  of  automated  claims  review,  encounter  reporting,  and  encounter 
abstracting  now  exist  in  selected  areas.  For  the  further  development  of 
ambulatory  reviews,  there  is  a  need  for: 

(1)    Expansion  of  the  data  available  on  claims  forms. 
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(2)  Centra!  collection  of  claims  forms  and  encounter  documents  from 
multiple  intermediaries. 

(3)  Expansion  and  refinement  of  local  criteria  for  frequency  of  visits  and 
quality  of  care  for  common  problems,  diagnoses,  and  clusters  of 
problems  or  diagnoses. 

(4)  Development  and  implementation  of  automated  audits. 

(5)  Development  of  effective  outputs,  by  educational  or  non-educational 
methods,  to  implement  the  audit  findings. 

D.  PATIENT  AND  PROVIDER  PROFILES 

Central  claims  and  encounter  reporting,  plus  the  rapidity  of  computer 
processing,  make  available  on-line  access  to  consumer  and  provider  profiles.  Such 
profiles  are  simply  a  listing  of  all  recent  claims  for  an  individual  patient  or  by  a 
specific  provider.  The  longitudinal  dimension,  however,  permits  the  identification 
of  patterns  which  might  not  be  evident  from  a  single  claim,  or  corroborates  the 
recurrence  of  a  problem  identified  on  a  single  claim. 

The  on-line  retrieval  of  longitudinal  consumer  profiles  is  now  a  reality  in 
New  Mexico' ,  for  Medicaid  patients,  and  will  soon  be  available  for  both  patients 
and  providers  there  and  elsewhere.  Criteria,  in  the  form  of  empiric  model  practice 
patterns,  are  being  developed  in  San  Joaquin^  and  elsewhere.  Patient  profiles  may 
be  used  by  trained  reviewers  to  aid  their  application  of  judgment.  Physician 
profiles  could  serve  as  an  approach  to  provider  certification. 

Clearly,  further  developments  in  this  area  are  dependent  upon  access  to  total 
health  service  information  for  a  defined  population.  At  present  such  information 
is  largely  limited  to  the  beneficiaries  of  Medicare  and  Medicaid,  and  to  those 
enrolled  in  prepaid  group  practice.  Further  expansion  of  Federal  health  programs, 
and  simultaneous  efforts  to  centralize  or  pool  claims  reports,  will  increase  the 
number  of  patients  on  whom  nearly  total  health  service  data  will  become  available 
to  permit  the  development  of  meaningful  profiles. 

Expansion  of  presently  available  criteria  will  be  needed  to  take  advantage  of 
these  developments.  Model  treatment  plans  for  more  conditions,  locally  devel- 
oped in  many  areas,  will  be  required.  Replication  of  the  New  Mexico 
methodology  for  the  storage  of  data  and  the  rapid  retrieval  of  patient  or  physician 


'  Hospital  Admission  Precertification  Program  (HAPP),  op.  cit. 

^Modcl  Treatment  Plans.  Work  in  progress.  San  Joaquin  Foundation  for  Medical  Care  c  f  the 
San  Joaquin  Medical  Society. 

50 


Arthur  DLittleJnc. 


profiles  will  be  needed.  Finally,  it  will  be  desirable  to  automate  the  application  of 
model  treatment  plans  to  the  review  of  patient  and  provider  profiles.  This  will 
require  new  computer  programs  whose  development  has  not  yet  been  started. 

in  summary,  computerized  storage  can  be  accomplished  for  all  reported  data 
describing  patient  care,  identified  by  unique  patient  numbers,  to  permit  the  ready 
development  of  longitudinal  profiles  of  patient  use  and  physician  practice. 

A  limited  number  of  model  treatment  plans  (longitudinal  criteria)  are 
currently  available  in  selected  sites.  A  model  for  on-line  automated  retrieval  of 
patient  profiles  has  been  developed  in  New  Mexico.  There  is  a  need  for: 

( 1 )  Expansion  and  refinement  of  local  model  treatment  plans; 

(2)  Replication  and  refinement  of  automated  profile  retrieval; 

(3)  Automated  comparison  of  model  treatment  plans  with  patient  profiles; 
and 

(4)  Development  of  unique  patient  coding  numbers  permitting  the  identifi- 
cation and  retrieval  of  longitudinal  profiles. 

E.  CONSUMER  SATISFACTION 

Peer  review,  by  definition,  has  been  professionally  oriented.  There  is  no 
reason  to  believe  that  the  consumers  of  medical  care  have  the  training  required  to 
evaluate  the  technical  proficiency  or  technical  appropriateness  of  medical  services. 
It  has  been  said,  "it  is  a  sin  of  vanity  to  believe  the  praise  of  grateful  patients. 
They  are  the  poorest  judges  of  medical  talent.  .  .  Beware  the  praise  of  an  honest 
admirer  who  has  insufficient  knowledge  and  background  to  judge  your  skill."' 

Nevertheless,  patients  do  make  judgments  which  influence  their  compliance 
with  recommended  medical  regimens  and  whether  or  not  they  return  for  further 
care.  Patients  are  competent  to  make  judgments  about  the  non-professional 
aspects  of  medical  care  such  as  cost,  convenience  and  personal  satisfaction.  These 
factors,  and  patient  judgments  concerning  them,  often  determine  whether  or  not 
adequate  care  is  actually  delivered  to  the  population. 

For  these  reasons,  despite  a  lack  of  unanimity,  most  of  our  panel  believed 
that  studies  of  consumer  satisfaction  should  be  an  element  of  the  general  review 
envisioned  by  P.L.  92-603.  Studies  of  consumer  satisfaction  with  medical  care,  as 


'Col.  Robert  H.  Moser  M.C.,  U.S.A.,  Medical  Opinion  and  Review,  Vol.  4,  No.  2,  February, 
1968. 
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evidenced  by  increased  patient  understanding  of  disease,  compliance  with  medical 
regimens,  rate  of  return  for  treatment,  and  specific  opinions  gathered  by  survey, 
have  been  conducted  by  various  behavioral  scientists.  Such  studies  are  currently  in 
the  realm  of  research.  They  have  not  been  significantly  implemented  in  any 
large-scale  medical  care  appraisal  system  but  could  be  conducted  or  commissioned 
by  PSRO's  on  a  sample  basis. 

In  summary,  multiple  sample  studies,  concerning  consumer  satisfaction,  can 
be  conducted  by  PSRO's  to  develop  appropriate  mechanisms  for  public 
accountability. 

Research  techniques  for  the  study  of  consumer  satisfaction  have  been 
developed  by  behavioral  scientists.  There  is  a  need  for: 

(1)  Apphcation  of  these  techniques  by  PSRO's  on  a  recurrent,  sample  basis; 
and 

(2)  Local  development  of  criteria  or  performance  standards  for  consumer 
satisfaction. 

F.  REGIONAL  MONITORING 

Excepting  the  studies  of  consumer  satisfaction,  the  review  programs 
discussed  thus  far  have  a  managerial  perspective  focusing  on  the  units  of 
production  (hospitals,  nursing  homes,  and  physician  offices).  An  epidemiologic 
perspective  would  focus  on  the  population  served. 

Effective  regional  studies  of  health  services  delivery  can  be  conducted  by 
PSRO's.  To  accomplish  this,  the  individual  services  reported  by  each  provider 
must  be  identified  by  a  patient  characteristic  such  as  home  location,  age,  sex, 
race,  or  socio-economic  status.  Aggregate  data  from  all  providers  can  be 
reassembled  in  terms  of  the  population  served,  and  expressed  as  population  based 
rates  per  1,000  or  100,000  persons  served  or  at  risk.  Cost  and  utilization  rates,  on 
this  basis,  can  be  developed  in  toto  and  for  specific  common  diseases  for  the 
entire  region,  and  for  specifically  defined  subpopulations. 

Regional  hospital  abstract  systems,  and  the  nursing  home  data  system, 
previously  discussed,  could  provide  the  PSRO  with  total  institutional  information 
for  its  designated  area.  Data  concerning  ambulatory  care,  however,  will  initially  be 
limited  to  the  beneficiaries  of  Federal  programs  and  the  members  of  prepaid 
groups.  Nevertheless,  the  latter  should  still  be  collected  and  compiled  as  a  step 
towards  total  reporting. 
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Statistical  indices  will  provide  the  PSRO  with  an  overview  of  regional 
practice,  to  permit  monitoring  the  impact  of  other  programs  and  the  identifica- 
tion of  specific  problem  areas  for  further  in-depth  study.  It  is  very  important, 
however,  for  the  PSRO  to  collect  and  aggregate  medical  care  data  both  on  a 
population  and  a  provider  basis.  This  simultaneous  approach  will  permit  an 
identification  of  the  source  of  any  detected  problem  for  further  study. 


The  statistical  indices  which  each  PSRO  should  monitor,  include: 

(1 )    Utilization  of  institutional  services 
Population  served  and  at  risk 


(2)  Cost  of  institutional  services 
Population  served  and  at  risk 

(3)  Reported  ambulatory  utilization  and  cost 
Population  served  and  at  risk 

(4)  Distribution  of  institutional  diagnoses 
Population  served  and  at  risk 

(5)  Mortality,  available  morbidity,  maternal 
mortality  and  perinatal  mortality 
Population  at  risk 


For  all  services, 
component  services, 
and  common  diseases 


Population  based  utilization  data  may  be  linked  with  other  bodies  of 
population  based  data  such  as  mortality  and  morbidity  to  permit  some  limited 
outcome  evaluations  within  the  region.  The  incidence  rates  of  certain  diseases, 
which  represent  inadequate  intermediate  outcomes  or  undesirable  complications, 
can  be  studied  from  this  data.  The  use  of  perinatal  mortality  rates  to  validate  the 
processes  of  prenatal  care,  and  the  incidence  of  rheumatic  fever  to  evaluate  the 
care  of  streptococcal  pharygitis  are  examples  of  such  approaches. 

The  analytic  and  statistical  techniques  for  regional  monitoring  are  the  classic 
tools  of  epidemiology.  Their  specific  application  to  this  function,  and  a  better 
understanding  of  their  significance,  would  rapidly  follow  the  availability  of 
centralized  regional  data. 

Existing  methods  need  to  be  extended,  and  new  instruments  developed  to 
assure  access  by  each  PSRO  to: 

(1)   Total  hospital  discharge  reporting  through  a  regional  abstract  system; 
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(2)  Total  nursing  home  reporting,  through  a  regional  nursing  home  data 
system ; 

(3)  As  much  ambulatory  data  as  possible  by  central  collection  of  claims 
reports  and  encounter  documents  from  multiple  sources; 

(4)  Demographic  data  from  the  census; 

(5)  Vital  statistics  from  the  local  public  health  departments;  and 

(6)  Institutional  facilities  data  from  regional  health  planning  agencies. 

In  summary,  each  PSRO  should  have  access  to  total  institutional  reporting 
and  as  much  ambulatory  care  data  as  possible  and  assemble  both  population  and 
provider  based  rates  for  the  utilization  and  cost  of  service  and  for  the  incidence  of 
specific  diagnosis.  These  rates  should  be  reported  for  the  population  served  and 
for  the  population  at  risk  and  used  to  monitor  the  processes  and  some  outcomes 
of  the  regional  health  delivery  system. 

Research  techniques  for  the  epidemiologic  study  of  health  services  dehvery, 
on  a  regional  basis,  now  exist.  There  is  a  need  for  new  guidelines  to  promote: 

(1)  Central  collection  of  provider  and  population  based  utihzation  and  cost 
data  by  the  PSRO;  and 

(2)  Application  of  research  epidemiologic  techniques  to  monitor  the  health 
delivery  system  in  the  designated  area  of  each  PSRO. 
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PSRO  DISTRICTING  CONSIDERATIONS 


P.L.  92-603  requires  the  Secretary  to  establish  appropriate  areas  throughout 
the  country  by  January  1,  1974,  and  at  the  earliest  practicable  date,  designate  a 
qualified  organization  as  the  PSRO  for  each  area. 

Significant  problems  lie  submerged  beneath  this  seemingly  bland  require- 
ment. Logically,  districting  should  be  determined  by  a  rationale  related  to  the 
proposed  functions  of  each  PSRO.  This  would  adhere  to  the  modern  architectural 
adage  of  form  following  function.  Lacking  such  a  rationale,  it  is  quite  probable 
that  PSRO  functions  will  be  constrained  and  in  part  dictated  by  districting,  or  to 
follow  the  analogy,  function  will  be  forced  to  accommodate  to  form  as  it  so  often 
must  in  poorly  designed  buildings. 

Furthermore,  districting  confronts  the  Secretary  with  a  maze  of  conflicting 
and  competing  local  geo-political  aspirations.  Powerful  central  cities  seek 
separation  from  their  states  and  dominance  over  the  immediate  adjacent  territory. 
Growing  suburbs  seek  independence  from  central  cities  for  the  very  reasons  which 
prompted  the  suburban  migration.  Rural  areas  distrust  both  the  cities  and  the 
suburbs  and  jockey  for  an  independent  political  voice  responsive  to  their  unique 
needs.  The  ghettoes  and  barrios  of  the  central  cities  similarly  perceive  indepen- 
dent control  as  the  only  means  to  meet  their  real  and  special  needs. 

The  geo-political  conflicts  described  above  are  common  to  all  public 
endeavors,  including  health.  Districting,  in  the  health  field,  is  further  compHcated 
by  inter-agency  and  inter-institutional  rivalries.  The  hospital  associations  cau- 
tiously protect  themselves  against  the  medical  societies  and  everybody  fears 
further  inroads  by  academia.  Large  hospitals  try  to  dominate  small  hospitals  and 
the  latter  fiercely  protect  their  independent  prerogatives. 

The  sensitive  nature  of  the  districting  issue  was  evidenced  throughout  our 
panel's  consideration  of  PSRO  organization  and  relationships.  We  were  constantly 
forced  to  return  to  districting  issues  and  to  structure  alternatives  for  other  issues 
in  relation  to  specific  districting  alternatives. 

Substantive  districting  considerations  are  presented  below  under  the 
headings  of  : 

•  Districting  rationale 

•  Districting  mechanics,  and 

•  Districting  precedents. 
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A.  DISTRICTING  RATIONALE 


1 .  Scope 

PSRO  could  be  implemented,  en  masse,  by  nearly  simultaneous  development 
in  almost  all  areas  of  the  country  so  as  to  provide  a  center  for  review  of  each 
ehgible  beneficiary.  Alternatively,  PSRO's  could  be  implemented  only  in  those 
areas  with  necessary  resources  and  pertinent  interests  and  allowed  to  grow  by 
expansion  and  repHcation  throughout  the  country. 

These  two  alternatives  impose  different  requirements  on  districting.  The 
former  approach  requires  districting,  in  relation  to  physicians,  institutions,  or 
populations,  throughout  the  country  so  that  all  areas  are  covered.  The  latter 
removes  the  constraint  for  total  coverage  and  permits  inclusion  of  the  local  ability 
to  perform  PSRO  functions  as  one  of  the  districting  criteria. 

P.L.  92-603  impHes  districting  of  the  entire  country.  More  importantly,  the 
discussions  of  the  Senate  Finance  Committee  leave  little  doubt  concerning  their 
desire  for  widespread  implementation  of  PSRO.  Our  consulting  panel  was 
concerned  that  the  requirements  for  PSRO  implementation  exceed  the  current 
state-of-the-art  and  the  resources  of  most  areas.  We  would  have  preferred  slower, 
more  evolutionary  implementation.  However,  we  recognized  that  the  intent  of  the 
law  precludes  this  as  an  alternative  for  districting.  Clearly,  districting  must  include 
the  entire  country.  The  quality  of  local  resources  for  PSRO  implementation  will 
be  evaluated  during  the  process  of  contract  negotiation,  but  will  not  significantly 
influence  districting. 

2.  Geographic  vs.  Non-Geographic  Districting 

Generally,  districting  implies  the  division  of  a  map  along  geographic  lines. 
Nevertheless,  the  legislative  emphasis  on  provider  participation  and  the  delegation 
of  review  to  qualified  institutions  suggested  an  alternative  to  at  least  one  member 
of  our  panel.  Might  groupings  of  providers  or  participating  institutions  serve  to 
define  the  districts? 

Were  all  the  providers  and  institutions  in  an  area  to  be  so  designated,  then 
this  approach  would  become  geographic  with  only  the  difficulty  of  defining  the 
outer  boundary  of  their  collective  service  area.  If  only  some  providers  and 
institutions  are  involved,  then  the  PSRO  program  would  serve  some  but  not  all  of 
the  beneficiaries  of  the  Social  Security  Act  hving  in  that  area.  Should  multiple 
PSRO's  be  designated  to  serve  the  same  limited  geographic  area,  the  confusion  of 
responsibility  and  reporting  lines  would  become  chaotic. 
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Furthermore,  one  of  the  major  functions  of  PSRO,  as  previously  defined,  is 
the  collection  of  "population  based"  medical  service  data.  This  requires  the 
aggregation  of  service  reports  from  all  providers,  and  precise  geographic 
boundaries  in  order  to  define  the  appropriate  demographic  denominators. 

Despite  its  consideration,  we  do  not  believe  that  a  non-geographic  basis  for 
districting  is  viable,  nor  do  we  believe  that  it  was  intended  by  the  legislation. 

3.  Size 

In  his  testimony  before  the  Senate  Finance  Committee'  Senator  Bennett 
stated  that  each  PSRO  should  include  a  substantial  number  of  practicing 
physicians  in  that  area,  generally  300  or  more.  Applying  the  national  ratio  of 
physicians  to  population,  this  represents  a  minimal  service  area  of  approximately 
250,000  persons.  Experience  with  EMCRO  demonstrates  only  one  program  this 
small  (Albemarle  County,  Virginia).  This  program  is  indeed  a  manageable  research 
model.  Its  cost  effectiveness  as  an  operational  PSRO  has  not  been  demonstrated, 
however.  There  is  reason  to  believe  that  PSRO's  should  be  somewhat  larger  to  be 
cost  effective.  Certainly  300-500  physicians  and  a  250-400,000  population 
represent  a  probable  minimum  size  for  each  PSRO. 

While  it  is  possible  to  so  estimate  the  minimum  size  for  a  prospective  PSRO, 
its  maximum  size  is  less  definable.  Conceptually,  maximum  size  should  be  a 
function  of  managerial  efficiency  and  effectiveness.  In  part,  this  will  depend  upon 
the  degree  to  which  each  PSRO  delegates  review  responsibility  to  qualified 
institutions.  A  current  example  of  larger  size,  without  apparent  loss  of  efficiency 
is  demonstrated  by  one  of  the  funded  EMCRO's  (Georgia)  which  includes  4,000 
physicians  and  serves  a  population  of  approximately  4,000,000.  Unfortunately, 
this  example  performs  some,  but  not  all,  PSRO  functions.  Many  Regional  Medical 
Programs  served  ±4,000,000  people  and  up  to  6,500  physicians  without  the  need 
for  significant  subdistricting.  The  inexact  parallel  between  RMP  and  PSRO 
functions  detracts  from  the  example.  Assuming  a  size  up  to  4,000,000  people, 
however,  PSRO  areas  could  encompass  all  but  the  five  largest  Standard 
Metropohtan  Statistical  Areas  (SMSA's)  in  the  United  States. 

It  may  become  necessary  to  develop  administrative  subareas,  when  an 
otherwise  rational  PSRO  becomes  too  large,  as  in  the  five  major  metropolitan 
centers  (SMSA's)  with  populations  over  4,000,000,  which  are  described  in  the 
following  Table  IV. 


'Congressional  Record,  January  25,  1972. 
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TABLE  IV 
SMGA's  OVER  4,000,000 


SMSA* 

New  York,  New  York 
Los  Angeles  —  Long  Beach 
Chicago 

Philadelphia  —  New  Jersey 
Detroit 


Population  -  April  1,  1970 


Total  Rank 

11,529,000  1 
7,032,000  2 
6,979,000  3 
4,818,000  4 
4,200,000  5 


Based  on  population  size,  physician  distribution  (clustering)  and  hospital 
origin  studies,  it  may  be  both  necessary  and  feasible  to  divide  each  of  these  five 
(5)  SMSA's  into  a  number  of  smaller,  more  manageable,  PSRO  subareas,  with  a 
"central"  PSRO  given  the  responsibility  for  coordination  of  the  entire  metro- 
poUtan  area.  Alternatively,  multiple  PSRO's  could  be  designated  for  these  large 
SMSA's  providing  they  all  use  a  common  data  set  and  provision  is  made  for  the 
free  exchange  of  data  throughout  the  medical  service  area. 

From  these  considerations,  it  would  appear  that  the  lower  and  upper  limits 
for  PSRO  size  would  be: 

Lower  Limit  Upper  Limit 

Physicians  300-500  Function  of  managerial 

Population  250,000-400,000        efficiency  and  effectiveness 

4.  Medical  Service  Areas  (Watersheds) 

A  more  fundamental  districting  consideration  relates  to  medical  service  areas 
or  medical  watersheds.  Ideally  one  PSRO  should  serve  each  self-sufficient  medical 
service  area.  A  medical  service  area  may  be  defined  by  geographic  boundaries 
within  which  most  of  the  medical  needs  of  the  population  are  met.  Medical 
service  areas  always  include  at  least  one  medical  school  or  a  major  medical  center. 
They  usually  center  about  larger  metropolitan  areas  (250,000  or  more)  and 
include  the  surrounding  rural  areas,  sometimes  encompassing  whole  states  or  even 
groups  of  thinly  populated  states.  Medical  service  areas  provide  a  fundamental 
rationale  for  districting  since  they  generally  define  communities  of  physicians,  a 
commonality  of  practice  patterns,  and  the  geographic  boundaries  for  interrelated 
health  data  collection. 
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The  issue  of  how  rural  practice  is  reviewed  relates  to  medical  service  areas. 
There  are  two  distinct  alternatives:  (1)  the  inclusion  of  rural  areas  in  the  adjacent 
metropolitan  review  area;  and  (2)  a  separate  and  distinct  rural  PSRO.  The  first 
option  increases  the  size  of  the  "metropolitan"  PSRO  but,  more  importantly,  is 
consistent  with  existing  patterns  of  medical  service.  The  second  option  is  less 
desirable  since  it  professionally  isolates  the  review  of  rural  practice  from  the 
urban  setting  upon  which  it  partly  depends.  This  latter  option  is  also  in  conflict 
with  recent  court  decisions  which  apply  national  or  broad  regional  standards  of 
care  to  each  individual  case,  regardless  of  location,  based  on  the  presumed  ease  of 
communication  and  transportation  which  now  exist. 

Medical  service  areas  or  watersheds  relate  closely  to  other  trade  areas.  They 
are  determined  partly  by  the  availabihty  of  medical  resources,  partly  by  such 
convenience  factors  as  distance  and  accessible  transportation,  and  partly  by  the 
trading  habits  of  each  community.  Medical  service  areas,  and  other  trade  areas  for 
that  matter,  develop  independent  of  and  without  regard  to  political  boundaries. 

Whole  counties,  or  groups  of  counties,  can  be  included  in  each  PSRO  district 
if  the  dependent  rural  areas  are  included  in  each  major  city  PSRO.  This  respect 
for  county  borders  will  keep  most  medical  societies  intact,  within  an  individual 
PSRO,  since  societies  are  generally  districted  by  counties  or  county  groups. 

New  England,  where  townships  rather  than  counties,  are  the  primary  mode 
of  pohtical  organization,  is  an  exception  to  this  general  rule.  Neither  SMSA's  nor 
medical  societies  are  districted  by  counties  in  New  England.  PSRO  districts  need 
not  follow  county  borders,  in  New  England,  since  counties  have  little  practical 
significance  in  that  area  of  the  country. 

State  borders  present  a  greater  problem.  Many  medical  service  areas  or 
watersheds  cross  state  boundaries.  Notable  examples  include:  New  York  City, 
Philadelphia,  Cincinnati,  St.  Louis,  Kansas  City,  and  Memphis. 

Practical  considerations  favor  PSRO  districts  which  lie  entirely  within  one 
state.  Many  federal  programs  are  implemented  by  the  delegation  of  responsi- 
bilities to  states.  Most  federal  programs,  excepting  some  regional  commissions  and 
the  Regional  Medical  Programs,  have  been  organized  entirely  within  states. 
Specifically,  Medicaid  has  been  implemented  somewhat  differently  by  each  state; 
Medicare  accreditation  has  been  conducted  by  individual  State  Health  Depart- 
ments; and  Medicare  intermediaries  have  been  designated  within  states.  Claims 
processing,  upon  which  some  PSRO  functions  may  depend  and  to  which  all  PSRO 
recommendations  need  be  reported,  will  be  conducted  by  different  agents,  using 
different  rules,  in  different  states. 
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These  considerations  favor  confining  PSRO  districts  within  state  borders. 
Medical  service  areas  which  cross  state  boundaries  must,  then,  be  served  by  more 
than  one  PSRO.  In  a  related  vein,  the  largest  medical  service  areas  may  need  to  be 
served  by  more  than  one  PSRO  simply  because  of  their  size.  Two  alternatives  are 
recommended  for  those  cases,  where  multiple  PSRO's  serve  a  single  medical 
service  area: 

(1)  Contracting  with  each  PSRO  for  review  and  appeal  functions,  only,  and 
maintaining  a  single  central  agency  for  data  collection  and  regional 
monitoring  throughout  the  entire  medical  service  area;  or 

(2)  Contracting  with  each  PSRO  for  all  functions  but  mandating  a 
requirement  for  common  and  compatible  data  and  the  free  com- 
munication of  data  between  all  of  the  PSRO's  within  each  medical 
service  area. 

Although  the  considerations  already  given  may  require  intra-state  PSRO 
districts,  it  is  important  to  recognize  the  feasibility  of  inter-state  PSRO  districts. 
Professional  review  need  not  depend  upon  the  input  of  claims  forms.  In  fact,  the 
ideal  sources  of  data  for  professional  review  come  from  providers  of  care  and  not 
from  financial  intermediaries.  Non-claims  input  data  may  include  precertification 
applications,  the  abstracts  of  an  on-site  concurrent  nurse  reviewer,  and  the  reports 
of  hospital  abstract  systems.  While  each  PSRO  must  report  its  recommendations 
to  the  intermediary  responsible  for  claims  processing,  freedom  from  dependence 
upon  an  input  of  claims  forms  makes  it  possible  to  envision  a  single  inter-state 
PSRO  serving  a  medical  service  area  which  crosses  state  borders.  Under  these 
circumstances,  each  PSRO  would  make  educational  inputs  in  the  state  where  the 
service  was  provided  and  reimbursement  reports  to  the  intermediary  in  the  state 
where  the  patient  is  resident.  Such  a  PSRO  would  be  required  to  accommodate  to 
two  different  sets  of  State  Medicaid  regulations  and  report  to  two  different  State 
Councils,  but  would  have  the  unique  opportunity  to  apply  the  common  medical 
standards  of  the  single  service  area  to  an  entire  metropohtan  region. 

B.  DISTRICTING  MECHANICS 

There  are  two  polar  alternatives  to  implement  districting  and  a  third  which 
represents  a  compromise  between  the  first  two. 

(1)  The  Secretary  may  designate  specific  geographic  areas  for  PSRO's 
which  cover  the  entire  United  States.  This  option  burdens  the  Secretary 
with  the  need  to  understand  local  circumstances  and  appreciate  local 
resources  throughout  the  nation.  More  importantly,  the  rigidity  of  this 
approach  creates  the  need  to  gather  a  voluminous  amount  of  local  level 
data  at  great  expense  and  with  time-consuming  effort.  In  light  of  these 
constraints,  this  approach  seems  least  appropriate. 
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(2)  The  Secretary  may  allow  "local"  or  "regional"  self-districting  based  on 
explicit  criteria  or  guidelines  which  he  promulgates.  This  approach  puts 
the  initiative  in  the  hands  of  the  applicant  agencies,  subject  to  review 
and  approval  by  the  Secretary.  This  option  would  not,  in  and  of  itself, 
assure  total  geographic  coverage  of  the  country. 

(3)  Given  the  somewhat  independent  constraints  in  the  first  two  options, 
the  Secretary  may  combine  these  two  approaches;  allowing  local  or 
regional  self-districting  in  conformance  with  a  "non-rigid"  master  plan 
to  assure  total  geographic  coverage.  This  third  option  offers  the  greatest 
flexibility  to  achieve  successful  implementation,  and  was  favored  by  the 
consulting  panel. 

C.  DISTRICTING  PRECEDENTS 

There  are  seven  major  districting  precedents  which  may  be  used  singly  or  in 
combination  as  criteria  to  determine  PSRO  districts  consistent  with  medical 
service  areas  and  the  size  constraints  discussed  earlier.  These  precedents  are  listed 
below,  in  order  of  importance,  as  viewed  by  the  consulting  panel. 

(a)  Standard  MetropoHtan  Statistical  Areas  (SMSA) 

(b)  Comprehensive  Health  Planning  (b)  Areas 

(c)  Hill-Burton  Planning  Areas 

(d)  RMP  Areas 

(e)  Patient  Origin  Areas  and  Specialty  Referral  Patterns  (Service  Areas) 

(f)  County  or  District  Medical  Society  Membership 

(g)  Hospital  Association  or  Council  Districts 

SMSA's  define  potential  populations  for  PSRO  review.  Since  both  physicians 
and  hospitals  tend  to  be  concentrated  in  cities,  SMSA's  serve  as  a  surrogate  for  the 
measurement  of  these  medical  resources.  Data  describing  the  SMSA's  in  the 
nation,  according  to  the  1972  Statistical  Abstract  of  the  United  States,  are  given 
in  Table  V. 
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TABLE  V 


SMSA'S  IN  THE  UNITED  STATES* 

Number  of  Population,  1970 

SMSA's  1970  In  Each  Size  Class  Cumulative 

In  Each  Cumula-  Total  %  of  Total  Total  %  of  Total 
Size  Class       tive      (inl.OOO's)      SMSA's     (in  1,000's)  SMSA's 


1970 
Population  Size 


Total  SMSA's ...  243 

3,000,000  or  more  6 

1 ,000,000-3,000,000  27 

500,000-1,000,000  32 

250,000-500,000  60 

100,000-250,000  92 

Less  than  100,000  26 


N.A.  139,419 

6  37,710 

33  42,946 

65  21,936 

125  19,761 

217  14,973 

243  2,091 


100.0         N.A.  N.A. 


27.0 

37,710 

27.0 

30.8 

80,657 

57.9 

15.7 

102,593 

73.6 

14.2 

122,354 

87.8 

10.7 

137,327 

98.5 

1.5 

139,419 

100.0 

Source:  Statistical  Abstract  of  the  United  States,  1972,  pg.  19. 

SMSA's  serve  to  define  medical  service  areas.  SMSA's  over  250,000  would 
approximately  meet  the  minimum  size  requirements  for  PSRO's  as  previously 
discussed.  These  125  PSRO  districts  would  account  for  122,354,000  people  or 
approximately  60  percent  of  the  population.  The  remaining  17,064,000  residents 
of  smaller  SMSA's,  and  the  63,793,000  non-metropoHtan  residents  (and  their 
physicians)  could  be  incorporated  in  the  SMSA  defined  PSRO  district  on  which 
they  depend  for  all  or  part  of  their  medical  service. 

Assuming  an  even  distribution  of  the  remaining  population  among  the  1 25 
PSRO  districts  defined  by  SMSA's  over  250,000  minimum  PSRO  size  would  be 
41 5,000  (or  approximately  500  physicians). 

Unfortunately,  SMSA's  over  250,000  cannot  be  used  as  a  sole  criteria  for 
PSRO  districting.  There  are  a  number  of  rural  states  which  have  only  one  or  two 
SMSA's  which  are  smaller  than  250,000.  Nevertheless,  these  cities  (such  as 
Portland,  Maine)  serve  as  the  nucleus  for  a  statewide  medical  service  area.  Such 
exceptions  are  easily  recognized  and  would  not  increase  the  number  of  PSRO 
districts  beyond  200. 

CHP  (a)  agencies  are  coterminous  with  states.  CHP  (b)  agencies,  covering 
metropolitan  areas,  are  most  often  coterminous  with  SMSA's  and  usually  describe 
medical  service  areas.  Hill-Burton  planning  areas,  which  are  generally  coterminous 
with  CHP  (a)  and  (b)  boundaries,  may  provide  another  criterion  for  districting 
PSRO's. 
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CHP  and  Hill-Burton  districts  were  originally  designed  as  medical  service 
areas.  Political  constraints  sometimes  produced  imperfect  implementation  of  this 
principle.  Nevertheless,  the  data  used  to  define  CHP  and  Hill-Burton  districts 
should  be  of  use  in  defining  medical  service  areas  for  PSRO  districts. 

Most  RMP  boundaries  are  coterminous  with  individual  state  borders  and  add 
little  information  for  districting.  In  a  minority  of  RMP's,  boundaries  were 
developed  to  include  multiple  sparsely  populated  states  or  a  dense  metropolitan 
population  straddling  state  boundaries.  These  latter  cases  do  provide  information 
to  help  define  pertinent  medical  service  areas. 

Definition  of  the  SMSA  "core"  of  each  PSRO  district  is  relatively  easy  from 
census  data.  Definition  of  the  outer  rural  boundaries  for  each  PSRO  district  is 
more  difficult,  particularly  in  those  border  areas  which  drain  into  two  or  more 
larger  centers.  CHP  (b)  and  Hill-Burton  boundaries,  and  other  data  which  they 
could  make  available,  will  help  define  the  outer  boundaries  for  each  PSRO 
district.  Other  pertinent  data  for  this  determination  should  include: 

(a)  Hospital  patient  origin  studies, 

(b)  Specialty  referral  patterns, 

(c)  Membership  in  County  or  District  medical  societies,  and 

(d)  Hospital  Association  or  Council  Districts. 
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PROFESSIONAL  STANDARD  REVIEW  ORGANIZATIONS 

(PSRO) 


A.  CONTRACTING 

1.  Foundations  for  Medical  Care  and  Alternatives 

P.L.  92-603  requires  the  Secretary  to  establish  appropriate  areas  throughout 
the  country  by  January  1,  1974,  and  at  the  earliest  practicable  date,  designate  a 
qualified  organization  as  the  PSRO  for  each  area.  A  quahfied  organization  will  be 
a  nonprofit  professional  association,  with  voluntary  membership,  including  a 
substantial  number  of  the  practicing  physicians  in  the  area  (generally  stated  at 
300  or  more).  Membership  in  the  PSRO  and  service  for  the  PSRO  cannot  be 
constrained  by  a  requirement  for  membership  in  or  payment  of  dues  to  a  medical 
society.  The  quahfied  organization  must  demonstrate  its  professional  competence 
to  review  health  care  services  in  a  formal  plan  submitted  to  the  Secretary. 

A.  geographic  basis  for  districting,  the  definition  of  a  qualified  organization, 
the  prohibition  against  dues  requirements,  and  the  ability  of  physicians  to  veto  a 
PSRO  contract  by  poll  (to  be  discussed  in  the  next  section)  all  suggest  that  most 
(if  not  all)  successful  PSRO  applicants  will  be  "medical  foundations."  Selected 
fiscal  intermediaries  and  an  occasional  CHP  or  RMP,  may  have  sufficiently 
intimate  relations  with  the  local  medical  community  to  be  acceptable  as  an 
organizational  sponsor  for  a  PSRO.  The  staff  of  a  large,  dominant  hospital  (or  a 
consortium  of  hospitals)  might  qualify  and  be  acceptable.  In  most  cases,  however, 
the  staff  of  an  individual  hospital,  clinic,  or  HMO  will  not  be  sufficiently 
representative  of  each  designated  geographic  area  to  qualify  as  the  PSRO,  but  may 
conduct  institutional  review  programs  delegated  to  them  by  the  PSRO. 

The  practical  restriction  of  PSRO's  to  medical  foundations,  in  most  cases, 
has  both  advantages  and  disadvantages.  The  arrangement  results  from,  and 
promotes,  an  attempt  to  gain  medical  cooperation.  Peer  review,  by  definition, 
depends  upon  peer  cooperation.  Furthermore,  this  approach  has  the  support  of 
the  American  Medical  Association.  Disadvantages  include  the  potential  conflict  of 
interest,  lack  of  medically  related  consumer  and  other  health  professional  inputs, 
and  potential  restriction  in  the  number  of  PSRO  applicants  or  the  possibility  of 
no  successful  candidates  in  some  or  many  designated  areas. 
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2.  Legal  Implications  and  Tinning  of  Polling  Requirements 

P.L.  92-603  provides  that  until  January  1 ,  1 976,  the  Secretary  will  be  able  to 
contract  only  with  a  qualified  organization  which  represents  a  substantial 
proportion  of  the  physicians  in  the  geographic  area  designated.  The  Secretary  is 
required  to  publish  notice  of  his  intention  to  contract  with  a  specific  qualified 
organization.  Until  January  1,  1976,  at  the  request  of  10  percent  or  more  of  the 
practicing  physicians  in  a  geographic  area  designated  by  the  Secretary,  the 
Secretary  will  be  required  to  poll  the  practicing  physicians  in  the  area  as  to 
whether  or  not  an  organization  of  physicians  which  has  requested  to  conclude  an 
agreement  with  the  Secretary  to  establish  a  PSRO  substantially  represents  the 
practicing  physicians  in  that  area.  If  more  than  50  percent  of  the  practicing 
physicians  in  the  area,  responding  to  the  poll,  indicate  that  the  organization  does 
not  substantially  represent  them,  the  Secretary  will  not  enter  into  an  agreement 
with  that  organization. 

The  legislative  language  describing  polling  is  time-constrained  prior  to 
January  1,  1976.  A  poll  prior  to  initial  contracting,  before  January  1976,  may  be 
required.  Repeat  polling  will  not  be  required  during  the  twelve  months  of  an 
initial  contract.  Theoretically,  one  subsequent  poll,  prior  to  recontracting,  might 
be  required  should  this  occur  before  January  1 ,  1976. 

Clearly,  the  possibility  of  a  poll  prior  to  initial  contracting  and  twelve 
months  later  with  recontracting,  will  discourage  all  but  the  most  "representative" 
physician  organizations.  One  hazard  is  that  this  uncertainty  may  decrease  the 
number  or  completely  eliminate  PSRO  applicants  in  certain  areas. 

It  was  previously  recommended  that  the  Secretary  allow  self-districting  for 
PSRO's  within  the  framework  of  defined  criteria  and  a  non-rigid  plan  for 
geographic  coverage.  The  necessity  for  a  poll,  should  it  be  required,  demands  that 
the  Secretary  precisely  district  in  order  to  determine  the  appropriate  physicians  to 
poll.  Such  districting,  itself,  may  determine  the  outcome  of  the  poll.  For  this 
reason,  the  use  of  "prophylactic"  polls  initiated  by  the  Secretary  is  not 
recommended.  Efficient  contracting  would  be  better  served  by: 

(1)  Required    endorsements   with    the    initial   application   to  indicate 
representation; 

(2)  Administrative  arbitration  by  the  Secretary  of  competing  or  over- 
lapping appUcations; 
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(3)  Publication  of  an  intention  to  contract  resulting  from  (1)  and  (2);  and 

(4)  Polling  only  when  requested  by  10  percent  or  more  of  the  physicians 
involved. 

3.  Recommended  Endorsements 

Endorsements  from  involved  professional  societies,  health  agencies  and 
institutions  should  be  required  with  the  initial  appUcation,  as  evidence  of 
representation.  Endorsements  from  the  State  or  County  Medical  Society  should 
be  mandatory.  Endorsements  from  the  state  hospital  association,  hospital 
planning  councils,  affected  hospitals,  nursing  homes,  and  possibly  HMO's  would 
be  optional.  These  endorsements  will  indicate  a  base  of  support  for  the  applicant 
agency  which  might  preclude  the  necessity  for  a  poll  or  indicate  the  successful 
outcome  of  a  poll  should  it  be  required. 

B.  ORGANIZATION 

The  organization  of  each  PSRO  is  not  constrained  by  law,  other  than  to: 

•  guarantee  representation  of  the  area  physicians,  and 

•  urge  widespread  physician  involvement  in  PSRO  functions. 

The  organizational  pattern  for  PSRO's  will  undoubtedly  vary.  Nevertheless, 
certain  common  functions  need  to  be  met. 

Functions  Agent  (or  Equivalent) 

1 .  Policy  Board  of  Directors 

2.  Management  Executive,  Staff,  Volunteer 

Committees 

3.  Operations  Staff,  Committees 

At  this  point  in  time  little  can  be  said  with  regard  to  management  or 
operational  functions.  Some  aspects  of  the  policy  function,  however,  warrant 
consideration.  The  Board  of  most  medical  foundations  is  appointed  by  the  parent 
medical  society.  To  the  extent  that  most  physicians  belong  to  and  participate  in 
medical  societies,  this  appointment  mechanism  promotes  the  mandated  represen- 
tation of  area  physicians  by  the  PSRO. 
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Satisfactory  PSRO  function  will  probably  depend  on  somewhat  broader 
representation,  including: 

•  physicians  who  do  not  belong  to  the  local  medical  society; 

•  physicians  who  belong  to  small  peripheral  medical  societies; 

•  osteopathic  physicians; 

•  allied  health  professionals; 

•  health  agencies  and  institutions;  and 

•  the  public. 

Given  the  climate  of  the  times,  and  the  controversial  pohtical  nature  of 
PSRO,  it  seems  hkely  that  some  significant  representation  for  all  these  diverse 
elements  will  be  necessary.  The  inherent  issue  is  at  what  organizational  level; 
Board  or  Advisory!  Pohcy  control  of  the  PSRO  has  been  given  to  physicians  by 
virtue  of  constraints  written  in  the  legislation.  Policy  control,  however,  should  be 
influenced  by  the  larger  health  services  constituency,  through  inputs  at  the  Board 
level.  Influential  representation  at  the  poUcy  level  should  be  provided  by  a 
carefully  structured  Board,  regardless  of  the  appointing  authority,  to  promote 
both  public  and  broader  professional  accountability  by  the  PSRO.  The  alternative 
option  is  the  use  of  an  Advisory  Committee.  The  major  disadvantage  of  this 
approach  is  the  relegation  of  non-M.D.  representation  to  a  non-effective  realm. 

C.  PHASING  AND  PROGRAM  DEVELOPMENT 

In  addition  to  the  minimum  set  of  PSRO  functions,  described  in  an  earlier 
chapter,  it  will  be  necessary  to  develop  a  logical,  programmed  methodology  for 
the  phased  implementation  of  additional  PSRO  functions.  These  functions  may 
include  nursing  home  evaluation,  ambulatory  review,  data  linkage  systems,  studies 
of  consumer  satisfaction,  and  review  programs  for  privately  financed  medical  care. 
Pre-programming  such  implementation  will  require  careful  dehberation  and  full, 
voluntary  cooperation  from  the  various  elements  of  the  local  health  delivery 
system.  Requiring  a  detailed  developmental  plan,  will  help  promote  such 
cooperation  early  in  the  hfe  of  each  PSRO  and  prevent  further  segmentation  of 
health  delivery  services. 
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D.  OPTIONAL  AND  NON-MANDATED  SERVICES 


PSRO's  may  choose  to  implement  peer  review  of: 

( 1 )  Ambulatory  care 

(2)  Privately  financed  medical  care  (Blues  and  Commercial  Carriers) 

At  present,  review  of  Federally  financed  ambulatory  care  is  optional,  and  the 
review  of  privately  financed  institutional  services  is  not  mandated  by  the 
legislation.  Careful  review  of  only  some  medical  services  implies  two  standards  of 
care  with  only  one  under  careful  scrutiny.  Recent  experience  demonstrates  the 
instability  of  a  two-standard  system. 

•  Ward  and  clinic  services  are  now  rejected  by  the  poor  who  seek  public 
funds  to  purchase  private  "one-class"  services. 

•  Medicare  mandated  utilization  review  has  generally  been  applied  to  all 
patients  regardless  of  source  of  payment. 

•  Some  Blue  Cross  Programs,  such  as  Blue  Cross  of  Northeast  Ohio,  have 
incorporated  certain  higher  Medicare  standards  into  their  commercial 
contracts. 

It  is  likely  that  legally  mandated  review  for  Social  Security  beneficiaries  will 
influence  the  entire  health  delivery  system  in  much  the  same  way  that  improved 
hospital  care  for  indigent  patients  promoted  the  present  widespread  demand  for 
private  hospital  use. 

The  review  of  non-mandated  services  is  initially  dependent  upon  voluntary 
cooperation.  However,  experience  has  shown  that  federal  regulations  do  have  an 
impact  on  the  private  sector  with  a  spill-over  of  effects  that  eventually  become 
custom.  Even  without  a  legal  mandate,  P.L.  92-603  will  promote  the  review  of 
medical  services  in  the  private  sector. 

E.  FINANCING  OF  DELEGATED  REVIEWS 

Certain  review  programs  will  be  delegated  by  each  PSRO  to  qualified 
institutions  or  agencies.  Many  PSRO's  will  depend  upon  data  inputs  from  Hospital 
Abstract  Systems. 
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The  costs  for  these  delegated  activities  may  be  considered  necessary  for 
PSRO  function  and  provided  to  the  PSRO,  directly  from  the  Trust  Funds,  for 
disbursement  to  the  operating  agencies  and  institutions.  Considering  the  power  of 
the  purse,  this  approach  would  significantly  enhance  the  strength  of  each  PSRO. 
Some  members  of  the  consulting  panel  favored  this  approach  since  it  would  more 
readily  identify  the  observable  direct  cost  of  the  review  program. 

Alternatively,  these  costs  may  be  considered  allowable  items  for  reimburse- 
ment and  transferred  to  the  initiating  institutions  for  collection  through  their 
regular  receipts  from  intermediaries.  This  second  option  was  favored  by  the 
balance  of  the  consulting  panel,  since  it  provides  a  ready  mechanism  for  joint 
public  and  private  financing  of  review  at  the  institutional  level  with  a  minimum  of 
additional  accounting  requirements.  This  option  need  not  dilute  the  control  of 
the  PSRO  which  would  still  have  the  ability  to  authorize  or  not  authorize  Federal 
payment  for  specific  institutional  review  programs.  This  approach  must  be 
accompanied  by  adequate  hospital  cost  accounting  to  identify  the  real  costs  of 
PSRO  review. 

F.  PSRO-EMCRO  RELATIONSHIPS 

Some  current  EMCRO's  will  undoubtedly  become  PSRO  applicants.  Future 
PSRO's  may  seek  EMCRO  funding  for  specific  research  or  development  projects. 

There  are  two  grey  zones,  inherent  in  the  distinction  between  operations  on 
the  one  hand  and  research  and  development  on  the  other.  These  distinctions 
concern: 

(1)  The  difference  between  evaluation  research  and  program  evaluation; 
and 

(2)  The  difference  between  project  development  and  the  initiation  of 
operational  programs. 

It  is  probable  that  perfect  definitions  of  these  distinctions  do  not  exist  and 
that  the  boundaries  between  operations  and  research  will  overlap.  An  obvious 
need  for  inter-program  coordination  at  the  Federal  and  local  level  is  therefore 
suggested.  Whether  EMCRO  remains  a  separate  program,  or  is  functionally 
consohdated  into  PSRO,  one  fundamental  principle  should  guide  its  research 
activities;  namely,  that  they  be  conducted  in  relation  to  the  needs  of  the  opera- 
tional program. 
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G.  PSRO-PSRO  RELATIONSHIPS 


It  is  likely  that  no  districting  of  PSRO's  can  perfectly  accommodate  to 
medical  service  areas;  and  that  patients  resident  in  the  area  of  one  PSRO  will 
receive  services  in  an  adjacent  PSRO  area.  This  will  be  particularly  evident  in  large 
SMSA's  and  metropolitan  areas  crossing  state  boundaries,  if  multiple  PSRO's  are 
required  for  these  areas.  These  facts  generate  a  need  for  the  flow  of  information 
concerning  patient  services  from  one  PSRO  to  another  and  for  special 
PSRO-PSRO  communication  mechanisms  and  both  common  and  compatible  data 
sets  when  the  required  interchange  is  frequent. 

H.  EVALUATION  REQUIREMENTS 

The  use  of  public  money  for  any  new  program  demands  that  evaluation 
requirements  be  incorporated  to  estimate  program  impact.  Regional  monitoring, 
through  Hospital  Abstract  Systems,  which  has  been  suggested  as  a  minimum 
function,  will  provide  some  evaluatory  data.  An  evaluation  methodology,  and 
common  minimum  reporting  requirements,  will  be  necessary  to  help  assure  the 
pubhc  accountability  of  the  program. 

It  is  important  to  include  program  monitoring  as  part  of  the  operational 
programs.  Collection  of  routine  data  could  serve  as  the  data  base  for  evaluation  of 
the  national  program  as  well  as  for  the  evaluation  of  individual  PSRO's.  Given  the 
time  constraints  and  financial  considerations  involved  in  developing  a  protocol  for 
program  monitoring  and  evaluation,  it  may  be  desirable  to  adopt  the  evaluation 
protocol  now  being  developed  for  the  EMCRO  program.  This  protocol  is 
apphcable  to  PSRO  evaluation  with  modest  modification. 

The  Protocol  for  the  Evaluation  of  EMCRO  prepared  by  Arthur  D.  Little, 
Inc.  for  the  National  Center  for  Health  Services  Research  and  Development  under 
the  terms  of  Contract  HSM  1 10-72-269  includes: 

(1)  Program  Monitoring:  organized  narrative  and  tabular  data  to  describe 
the  activities  of  each  EMCRO.  The  material  included  covers  for  each 
EMCRO: 

•  the   region   served   (population,  physicians,  hospitals,  nursing 
homes,  and  intermediaries) 

•  program  organization  (board,  individual  and  organizational  partic- 
ipants, staff,  effort  distribution,  and  financing) 
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•  projects 

•  criteria 

(2)  Research  Models:  to  evaluate  the  impact  of  each  program  or  project  on 
the  quahty  of  medical  care  and  on  the  cost  of  medical  service  in 
controlled,  quasi-experimental  circumstances. 

(3)  Comparison  of  Criteria:  methods  to  identify  the  differences  between 
criteria  sets  developed  in  different  sites;  methods  to  measure  the  costs 
of  criteria  development;  and  methods  to  measure  the  cost  of  care  which 
would  be  generated  by  perfect  compliance  with  different  criteria. 

(4)  Test  Sample  Review:  preparation  of  a  test  sample  of  hospital  charts  to 
be  processed  at  each  site  to  check  the  completeness  and  accuracy  of 
abstracting,  the  variable  application  of  judgment,  and  the  differences  in 
conclusions  when  the  review  is  conducted  by  different  methods. 
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PSRO  STATE  COUNCILS 


P.L.  92-603  requires  that  in  any  state  with  three  or  more  PSRO's  the 
Secretary  will  establish  and  appoint  the  membership  of  a  State  Council  which  will 
include: 

•  One  representative  designated  by  each  PSRO. 

•  Four  physicians  (two  designated  by  the  state  medical  society  and  two 
designated  by  the  state  hospital  association). 

•  Four  knowledgeable  public  representatives  (two  recommended  by  the 
Governor  of  the  state). 

Each  State  Council,  and  the  PSRO's  in  states  without  a  Council,  will  have  an 
Advisory  Group  of  seven  to  eleven  members  including  representatives  of  health 
care  practitioners,  other  than  physicians,  and  hospitals  and  other  facilities  which 
provide  Medicare  and  Medicaid  services  in  the  state.  The  Secretary  will  provide 
regulations  to  determine  the  manner  in  which  the  Advisory  Group  is  selected. 

The  State  Councils,  where  established,  will: 

•  Review,  comment  upon,  and  transmit  to  the  Secretary  any  reports 
received  from  the  PSRO's  concerning  violations  of  the  Program. 

•  Review  any  appeals  to  a  PSRO  decision  involving  more  than  $100. 

•  Coordinate  the  activities  of,  and  disseminate  information  and  data 
among,  the  various  PSRO's  in  the  state. 

•  Assist  the  Secretary  in  developing  uniform  data  gathering  procedures  to 
insure  efficient  and  objective  comparison. 

•  Assist  the  Secretary  in  the  evaluation  of  each  PSRO. 

•  Assist  the  Secretary  in  developing  and  arranging  for  a  qualified  PSRO 
replacement,  when  necessary. 

The  legislation,  then,  explicitly  defines  when  a  State  Council  is  required,  its 
composition  and  appointment,  and  major  functional  responsibilities. 
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It  is  conceivable  under  the  law  that  many  states  (those  with  less  than  three 
PSRO's)  would  not  require  a  State  Council.  This  would  burden  the  one  or  two 
PSRO's  in  these  states  with  the  task  of  conducting  required  State  Council 
functions  and  would  complicate  the  appeals  function.  Further,  it  would  place 
PSRO's  with  a  State  Council  at  a  disadvantage  by  not  having  a  direct  channel  to 
the  national  office.  More  importantly,  since  state  governments  have  a  financial 
interest  in  Medicaid  (Title  XIX),  their  formal  input  would  be  sadly  lacking  in 
those  states  without  a  State  Council.  Based  on  these  i:onsiderations,  the  panel 
recommended  the  establishment  of  a  State  Council  in  every  state. 

An  alternative  to  a  State  Council  in  each  State  was  considered.  Proximate 
states  with  common  interests  and  few  PSRO's  may  choose  to  share  State  Councils 
on  a  voluntary  basis.  Three  likely  possibilities  might  be  the  Mountain  States,  the 
Southwest,  and  Northern  New  England.  Maine,  New  Hampshire,  and  Vermont, 
for  example,  are  likely  to  each  have  one  state-wide  PSRO.  Their  medical  problems 
and  general  attitudes  are  similar.  Furthermore,  there  is  a  history  of  joint 
cooperative  ventures.  They  may  choose  to  share  and  jointly  appoint  a  common 
multi-State  Council. 

A.  AGENCY 

State  governments  do  not  contribute  to  Medicare  financially,  but  do  share 
current  review  responsibilities  for  this  program.  More  importantly,  state  govern- 
ments are  responsible  for  the  costs  of  Medicaid  under  varying  matching  formulae. 
These  are  potent  arguments  for  a  public  State  Council.  The  disadvantages  of  a 
governmental  State  Council  include  the  lack  of  initiative  and  imaginative 
programming  in  most  State  Health  Departments  and  medical  hostility  to  more 
governmental  intervention. 

The  responsibility  for  initiating  a  State  Council  depends  to  some  degree  on 
its  locus.  If  governmental,  its  development  could  be  requested  by  the  Secretary 
and  required  by  the  Governor  or  his  agents.  If  private  not-for-profit  a  suitable 
sponsor  need  be  identified.  If  the  logic  of  PSRO  sponsorship  is  followed,  at  the 
State  level,  the  State  Medical  Society,  or  one  of  its  subsidiary  corporations,  would 
be  the  prime  candidate  for  sponsorship. 

Because  of  the  use  of  matching  state  funds  for  Medicaid,  the  panel  agreed 
that  there  should  be  a  significant  state  governmental  input  on  the  PSRO  State 
Council.  In  the  panel's  opinion,  the  Council  should  include  selected  state 
governmental  agents  such  as  the  Comniissioners  of  Public  Welfare  and  Public 
Health  as  well  as  the  variety  of  non-state  employees  specified  by  P.L.  92-603. 
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Despite  intermittent  Council  meetings,  many  Council  functions  must  be 
continuous.  A  secretariat  will  have  to  be  provided  by  a)  the  Governor's  Office,  b) 
the  State  Health  Department,  c)  the  State  Welfare  Department,  or  d)  by  a 
not-for-profit  private  agency. 


B.  FUNCTIONS 

The  specific  functions  of  the  State  Council,  including  coordination, 
assistance,  appeals,  and  advice,  are  explicitly  defined  in  the  legislation. 


C.  ORGANIZATION 


The  organization  of  the  State  Council  should  relate  to  its  functions.  The 
appeals  mechanism  requires  a  hierarchical  relationship  with  the  State  Council 
standing  between  the  PSRO  and  the  National  Agency.  Coordination,  assistance, 
and  advice  do  not  necessarily  require  a  hierarchical  relationship.  We  visualize  two 
separate,  but  not  mutually  exclusive  organizational  models  for  the  State  Council. 


Appeals  (Hierarchical) 


PSRO 


National  Program 


State  Council 


Coordination,  Assistance 
Advisory  (Non-Hierarchical) 


National  Program 


State 
Council 


PSRO 


PSRO  PSRO 


PSRO 


PSRO 


Management  of  the  National  Program  would  be  facilitated  by  some  hmited 
number  of  intermediate  reporting  points,  such  as  State  Councils.  Fifty  Councils, 
however,  would  fail  to  increase  efficiency;  furthermore,  the  variety  of  pohcy 
inputs  would  introduce  a  notable  lack  of  uniformity  into  the  PSRO  program. 
Alternately,  efficient  management  of  the  Program  could  be  developed  by  having 
PSRO's  report  through  HEW  Regional  Offices  or  through  regional  "desks"  at  the 
national  level.  This  approach  would  preserve  the  uniformity  of  the  Program. 

The  necessity  for  hierarchical  function  by  the  State  Council  with  regard  to 
appeals  was  recognized.  A  non-hierarchical  advisory  role  for  the  other  functions 
of  the  State  Council,  however,  was  recommended.  This  relationship  is 
diagrammed  below: 
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D.  ADVISORY  GROUP 

The  legislation  is  vague  regarding  the  composition  and  function  of  the 
Advisory  Group  for  the  State  Council.  The  issue  is  whether  the  Advisory  Group  is 
merely  "window  dressing"  or  a  responsible  vehicle  for  input  from  the  regional 
health  services  constituency.  The  panel  adopted  the  latter  viewpoint  and  felt  that 
the  Advisory  Group  would  be  most  effective  as  a  standing  committee  of  the  State 
Council.  The  panel  recommended  expansion  of  the  State  Council  membership, 
beyond  the  limited  requirements  of  the  law,  to  incorporate  both  the  Advisory 
Group  and  a  separate  Appeals  Committee.  Under  these  circumstances,  an 
Executive  Committee  would  be  responsible  for  coordination  and  assistance  and 
special  subcommittees  for  appeals  and  advice.  The  membership  of  the  State 
Council  would  include  the  membership  of  the  Executive  Committee,  Appeals 
Committee,  and  the  Advisory  Group.  This  composition  of  the  State  Council  is 
diagrammed  below. 

State  Council 


Executive  Committee 


Appeals 
Committee 


Advisory 
Group 
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THE  NATIONAL  PROGRAM 


A.  ADMINISTRATION 
1.  Locus 

Administration  of  the  PSRO  Program,  at  least  theoretically,  could  be  located 
in  a  number  of  different  Federal  sites,  including: 

(a)  The  Secretary's  Office 

•  Under  Secretary 

•  Assistant  Secretary  for  Health 

•  A  new  Assistant  Secretariat 

(b)  The  Fiscal  Agencies 

•  Social  Security  Administration 

•  Bureau  of  Health  Insurance  (BHI)  of  SSA 

•  Medical  Service  Administration  (MSA)  of  SRS 

(c)  The  Health  Services  and  Mental  Health  Administration  (HSMHA) 

•  Community  Health  Service 

•  A  new  and  separate  program  within  HSMHA 

(d)  A  new  Administration  on  a  par  with  HSMHA 

A  schema,  presenting  nine  possible  options  for  the  locus  of  the  National 
Program,  is  given  in  Figure  3.  The  options  are  numbered  and  keyed  to  the 
following  discussion. 

a.  The  Secretary's  Office 

A  locus  in  the  Secretary's  Office,  whether  at  the  level  of  the  Under  Secretary 
(1),  the  Assistant  Secretary  for  Health  (2),  or  a  new  Assistant  Secretariat  (3), 
would  place  the  PSRO  Program  over  both  the  health  and  fiscal  arms  of  HEW.  This 
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would  solve  the  problem  of  split  funding  between  MSA  and  BHI,  and  provide 
PSRO's  with  greater  status  in  the  Federal  hierarchy.  Location  at  one  of  these 
levels  would  provide  national  prominence.  The  effectiveness  of  the  PSRO 
Administration,  however,  would  be  diluted  by  separation  from  the  operational 
health  and  fiscal  programs. 

The  most  appropriate  expertise  within  the  Secretary's  Office  is  located  in  the 
Office  of  the  Assistant  Secretary  for  Health.  Lack  of  appropriate  staff  would  have 
to  be  solved  by  major  recruitment  efforts;  this  problem,  however,  would  be 
common  to  any  locus  for  the  new  Program.  The  major  disadvantage  of  the 
Secretary's  Office  is  the  absence  of  any  precedent  for  housing  an  operational 
program  at  this  level. 

b.  The  Fiscal  Agencies 

The  National  PSRO  Administration  could  be  housed  in  the  Bureau  of  Health 
Insurance  (4),  elsewhere  within  the  Social  Security  Administration  (5),  or  in  the 
Medical  Service  Administration  (6). 

BHL  by  virtue  of  its  present  regulatory  responsibihties  with  regard  to 
Medicare,  has  actively  sought  to  implement  the  PSRO  Program.  There  is,  in  fact, 
an  inherent  logic  in  the  association  of  a  regulatory  program  with  the  agency  which 
has  programmatic  fiscal  control.  Nevertheless,  two  arguments  militate  against 
administering  PSRO's  in  BHL 

(1)  Since  the  Bureau  is  responsible  for  Medicare  but  not  Medicaid,  it  could 
provide  an  association  with  only  part  of  the  Federally  funded  health 
program . 

(2)  More  importantly,  the  Bureau  is  not  well  regarded  by  practicing 
physicians  and  organized  medicine,  who  view  it  as  an  accounting  rather 
than  a  professional  agency. 

This  locus  for  PSRO  Program  control  would  guarantee  less  than  whole 
hearted  cooperation  from  the  community  of  practicing  physicians. 

c.  The  Health  Services  and  Mental  Health  Administration 

The  Health  Services  and  Mental  Health  Administration  provides  the  major 
repository  of  health  delivery  expertise  within  the  Federal  government.  This  fact 
strongly  recommends  it  as  a  locus  for  the  PSRO  Program  or  defines  a  major 
advisory  role.  Within  HSMHA,  the  Community  Health  Service  could  serve  as  the 
location  for  PSRO  (7).  Recent  experience  with  CHP  and  RMP,  however,  has 
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demonstrated  the  importance  of  a  separate  program  to  promote  the  status 
necessary  to  gain  physician  cooperation.  Based  on  this  consideration,  it  would  be 
best  to  consider  a  separate  Program,  should  PSRO's  be  located  within  HSMHA 
(8).  Locus  at  these  levels,  though,  would  greatly  diminish  the  national  prominence 
and  visibility  of  the  Program. 

d.  A  Separate  Administration  on  a  Par  with  HSMHA 

The  management  of  PSRO  could  be  housed  in  a  new  Administration  on  a  par 
with  HSMHA  (9).  Such  an  Administration  could  house  all  of  the  operational 
facets  of  the  PSRO  Program  and  still  report  directly  to  the  Assistant  Secretary  for 
Health.  This  approach  builds  on  historic  precedent  and  gives  the  new  program  the 
level  of  visibility  which  the  Department  has  committed  to  Congress.  The  approach 
has  the  disadvantage  of  compHcating  the  structure  of  the  Department  and  shares 
with  other  approaches  the  need  for  new  personnel. 

The  consulting  panel  addressed  these  varied  options  for  the  location  of  the 
PSRO  Administration.  Initial  concern  centered  about  the  distinction  between  a 
small  PSRO  Administration  charged  with  providing  coordination,  leadership  and 
policy  direction  for  activities  in  other  Departmental  components  as  opposed  to 
the  consolidation  of  all  requisite  PSRO  functions  in  a  single  Administration.  Tasks 
considered  essential  to  the  success  of  the  PSRO  Program  include: 

( 1 )  Policy  development  and  administration 

(2)  Technical  assistance,  and 

(3)  Program  monitoring,  evaluation,  and  research. 

The  panel  felt  that  coordination,  as  a  functional  mode,  had  less  chance  of 
success  than  consolidation.  This  opinion  was  based  on  management  expertise,  the 
unsatisfactory  history  of  prior  Federal  coordinative  efforts,  and  the  dilution  of 
PSRO  priorities  in  the  face  of  dependence  on  other  agents  for  implementation. 

The  panel  was  next  concerned  with  giving  the  PSRO  Administration  the 
greatest  possible  visibility  and  status.  While  a  locus  within  the  Secretary's  Office 
best  satisfied  this  condition,  no  precedent  was  found  for  a  consolidated 
operational  agency  at  that  level.  Location  of  the  PSRO  Administration  in  BHI,  as 
a  HSMHA  Program,  or  within  a  HSMHA  Program  was  not  considered  sufficient 
visibility. 

For  the  reasons  given,  the  panel  recommended  administrative  consolidation 
of  all  major  PSRO  functions  in  a  new  Administration  (on  a  par  with  HSMHA) 
reporting  to  the  Assistant  Secretary  for  Health.  This  option,  number  (9)  on  the 
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previous  schema,  was  viewed  as  the  best  compromise  between  the  conflicting 
demands  for  consohdation  and  visibility. 

The  recommended  solution  does  not  obviate  the  need  for  liaison  with  the 
fiscal  agencies  (BHl  and  MSA)  both  for  information  purposes  and  to  provide  the 
funding  for  PSRO  field  operations.  These  relationships  are  described  in  Figure  4. 

2.  Functions 

The  functions  of  Federal  administration  are  relatively  clear  cut,  following 
from  the  requirements  of  the  legislation  and  the  models  of  prior  national 
programs.  They  will  include: 

•  Guideline  preparations, 

•  Districting, 

•  Selection  and  funding  of  PSRO, 

•  Technical  assistance  to  PSRO's, 

•  Central  data  collection, 

•  Evaluation,  and 

•  Support  for  the  National  PSRO  Council. 
B.  NATIONAL  COUNCIL 

1 .  Organization 

The  composition  of  the  National  Council  is  specified  by  the  legislation.  It 
will  consist  of  11  members  (including  the  chairman)  all  appointed  by  the 
Secretary.  A  majority  of  the  members  will  be  recommended  by  national 
organizations  representing  physicians,  but  the  Council  will  include  physicians 
recommended  by  consumer  groups  and  other  health  care  interests,  as  well.  All 
members  will  be  physicians  of  recognized  standing  and  distinction  in  the  appraisal 
of  medical  practice. 

The  role  of  the  National  Council  vis-a-vis  the  Administrative  Agency  for 
PSRO  needs  to  be  developed.  Will  the  National  Council  serve  in  an  advisory 
capacity  or  have  administrative  authority  over  the  Federal  Agency?  Existing 
models,  developed  at  NIH  and  later  used  by  HSMHA,  utilize  such  Councils  to: 
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•      Evaluate  and  help  determine  Agency  policy,  and 


•      Select  the  most  qualified  applicants  for  approval  and  renewal  of 
funding. 

This  common  mode  for  National  Councils  is  most  likely.  Given  the  existing 
precedents  and  recent  poHcies  set  for  the  Executive  Department,  the  National 
Council  will  serve  an  advisory  role  without  line  authority  over  the  PSRO 
Administration.  Clerical  and  executive  support  will  be  required  and  should  be 
provided  by  the  National  PSRO  Administration. 

2.  Functions 

The  major  functions  of  the  National  PSRO  Council  are  specified  by  the 
legislation.  The  Council  will: 

(1)  Advise  and  assist  the  Secretary  in  the  administration  of  the  Program. 

(2)  Prepare  and  distribute  regional  "norms,"  with  periodic  revisions,  based 
on  a  review  of  appropriate  and  adequate  data. 

(3)  Provide  technical  assistance  in  the  utilization  of  such  norms  of  care  and 
treatment. 

(4)  Review   the   comparative   performance   and   effectiveness  of  State 
Council's  and  PSRO's. 

(5)  Recommended  measures  to  improve  the  Program. 

(6)  Submit  an  annual  report  to  the  Secretary  and  to  the  Congress. 

Most  of  these  functions  are  self-explanatory.  The  relationship  between  the 
National  Council  (or  the  PSRO  Administration)  and  each  PSRO  with  regard  to 
standard  setting  is  a  critical  issue,  however.  The  legislation  alternately  states  that 
standards  will  be  determined  from  regional  data,  and  that  standards  will  be 
developed,  updated,  and  explained  by  the  National  Council.  The  issue  is  the 
acceptability  of  national  standards  and  the  allowable  degree  of  regional  variation. 

Since  the  source  of  data  for  standards  must  be  regional,  it  is  likely  that 
standards  will  be  initiated  by  local  PSRO's.  This  probability  is  further  enforced  by 
observations  in  current  EMCRO's,  where  locally  developed  standards  were  needed 
to  gain  physician  cooperation.  Local  standards  will  be  reviewed  nationally. 
Significant  deviations  will  require  explanation.  It  is  likely  that  any  controversy 
between  the  National  Program  and  its  local  operational  arms  will  arise  over  this 
issue. 
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Given  the  critical  nature  of  the  issue,  it  is  wise  to  examine  quahty  and 
volumetric  standards  separately.  Local  quality  standards  will  probably  aim  at 
optimum  levels,  if  the  experience  of  EMCRO  is  reproduced.  National  require- 
ments for  at  least  minimum  quality  standards  will  probably  be  easily  met. 
Conflict  between  national  and  regional  norms  for  length  of  hospital  stay  is  more 
probable.  The  solution  to  this  problem  will  be  found  in  the  judicious  use  of  time 
and  administrative  negotiation  between  the  PSRO  Administration  and  each  local 
PSRO.  Local  norms  should  be  accepted  initially  and  compared  at  the  national 
level.  Evaluation,  administrative  negotiation,  and  the  dissemination  of  compar- 
ative data  will  gradually  bring  local  norms  in  Une  with  national  standards. 

C.  TECHNICAL  ASSISTANCE 

Given  the  shortage  of  Federal  personnel,  it  is  hkely  that  the  technical 
assistance  provided  to  the  PSRO  will  be  obtained  through  contract  services. 
Technical  assistance  will  be  conducted  at  four  levels. 

(a)  Demonstration  Programs 

Experience  gained  by  EMCRO's  or  mature  medical  foundations,  which  have 
been  shown  to  be  successful,  can  provide  suitable  demonstrations.  Visits  to  such 
operational  agencies  are  an  important  form  of  technical  assistance. 

(b)  Manuals  and  Training  Sessions 

Time  and  personnel  constraints,  and  primary  dedication  to  an  operational 
mission,  limit  the  direct  use  of  EMCRO's  or  Foundations  for  this  purpose. 

Program  manuals  can  be  prepared  to  describe  the  organization  and  methods 
of  existing  programs.  Training  sessions,  using  these  manuals,  may  be  conducted  on 
local,  regional,  and  national  levels.  This  approach  would  increase  the  dissemina- 
tion of  current  EMCRO  and  Foundation  data. 

(c)  On-Site  Consultation 

Technical  assistance  will  be  required  to  aid  developing  PSRO's.  This  task  will 
probably  require  contract  services  performed  at  the  location  of  the  prospective 
PSRO.  As  with  HMO  technical  assistance  contracts,  consultants  with  the  requisite 
skills  and  experience  can  be  retained  on  a  national  or  regional  basis  and  made 
available  to  developing  PSRO's. 
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(d)  Specific  Tasks 

Specific  tasks  such  as  the  development  of  norms  or  the  development  of  an 
evaluation  approach  can  be  conducted  by  contract.  Consulting  firms,  EMCRO  or 
Foundation  staff,  the  American  Medical  Association  and  specific  members  of  the 
academic  community  would  be  pertinent  to  these  tasks  or  their  subcomponents. 
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PART  II 


CERTIFICATION  OF  NEED  FOR  AND  VOLUMETRIC 
APPRAISAL  OF  MEDICAL  CARE 


by 


Elaine  Israel 


CERTIFICATION  OF  NEED  FOR  AND  VOLUMETRIC 
APPRAISAL  OF  MEDICAL  CARE 


by  Elaine  Israel 

INTRODUCTION 

Conceptually,  medical  need  must  be  clearly  distinguished  from  demand/ want 
in  the  medical  care  process.  Traditionally,  medical  need  has  been  professionally 
determined,  although  not  always  appropriately,  while  demand/want  is  deter- 
mined, somewhat  independently,  by  many  socio-economic  perceptions  of  a 
population.  Early  efforts  by  Ciocco,  et.al.  (41)  attempted  to  describe  need  as 
being  determined  by  pathological  processes  in  the  human  organism,  whereas 
demand  is  determined  by  the  patient's  intelligence  (among  other  variables)  to  seek 
and  obtain  the  services  he  needs.  They  went  on  to  state  that  demand  (economic) 
is  measured  in  units  of  goods  or  services  actually  received  by  the  consumer. 
Medical  need  is  measured  in  units  of  service  required  (and  utilized)  for 
preservation  of  health  and  treatment  of  disease.  While  the  need  for  care  is  initially 
certified  by  professional  determination  various  methodologies  also  have  been 
developed  to  evaluate  the  volume  of  services  (volumetric  appraisal)  used  in 
inpatient  and  outpatient  settings.  Typically,  these  have  focused  on  length  of  stay 
reviews  and  numbers  of  visits,  respectively.  This  paper  will  review  these 
considerations  within  the  following  conceptual  framework: 

•  Demand /Want  for  Medical  Care 

•  Need  for  Care 

•  Certification  of  Need 

•  Methodologies  for  Certification 

•  Volumetric  Appraisal  of  Utilization  of  Hospital  Services 

Demand/Want  for  Medical  Services 

Jeffers,  et.al.  (158)  defined  the  demand  for  medical  services  as  that  which 
arises  out  of  consumers  attempting  to  satisfy  their  psychologically  formulated 
wants.  Wants  serve  as  the  basis  for  the  formulation  of  consumer  tastes  and 
preferences  for  goods  and  services.  Economists  traditionally  assume  wants,  and 
consequently  consumer  tastes  and  preferences,  as  "given"  and  then  proceed  to 
explore  the  market  consequences  of  any  given  set  of  tastes  and  preferences. 
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To  satisfy  wants,  consumers  enter  the  market  place  seeking  to  exchange 
money  for  those  goods  and  services  that  are  desired.  However,  since  most 
consumers  possess  Umited  financial  resources,  and  the  goods  and  services  they 
desire  have  positive  prices,  they  cannot  buy  all  the  goods  and  services  in  the 
quantities  they  desire.  It  is  assumed  that  consumers  are  rational  and  allocate 
available  financial  resources  among  alternative  goods  and  services,  purchasing  that 
combination  of  them  which  yields  the  maximum  satisfaction  attainable,  given 
their  limited  financial  resources  and  the  prices  of  goods  and  services  in  the  market 
place. 

Therefore,  the  quantity  of  medical  services  demanded  by  a  given  population 
depends  on  collective  consumer  wants  (tastes  and  preferences)  for  all  goods  and 
services,  prices  of  medical  services,  the  prices  of  alternative  goods  and  services,  the 
size  of  the  population,  and  the  financial  resources  available  to  its  members. 

Based  on  these  considerations  Jeffers,  et.al.  (158)  defined  the  economic 
concept  of  a  given  population's  demand  for  medical  services  as:  "A  multivariate 
functional  relationship  between  the  quantities  of  medical  services  that  its 
members  desire  to  consume  over  a  relevant  time  period  at  given  levels  of  prices  of 
goods  and  services,  financial  resources,  size  and  psychological  wants  of  the 
population  as  reflected  by  consumer  tastes  and  preferences  for  (all)  goods  and 
services." 

The  specification  of  the  demand  function  is  an  intellectual  exercise  in  which 
the  primary  goal  is  to  specify  those  factors  that  are  Hkely  to  be  important 
determinants  of  the  quantity  of  services  purchased  by  consumers. 

Griffith  (129)  examines  the  concept  of  demand  (quantitative  rather  than 
economic)  as  it  relates  to  the  allocation  of  hospital  resources.  He  asks  the 
questions:  Where  does  demand  come  from,  what  is  the  underlying  process  which 
generates  it,  and  what  is  important  in  a  thorough  description  of  the  demand?  For 
most  hospital  functions,  demand  comes  from  the  decisions  made  by  doctors 
about  patients,  but  these  decisions  themselves  are  the  result  of  a  complex  process. 

Most  of  the  services  of  hospitals  are  not  sought  directly  by  the  patient.  They 
are  demanded  as  a  part  of  a  larger  process  through  which  the  citizen  seeks  the 
treatment  or  prevention  of  some  health  problem.  The  demand  for  laboratory 
examinations,  hospital  admission,  x-ray,  and  other  services  is  not  generated  by  the 
patient  but  by  his  doctor.  An  understanding  of  the  process  by  which  demand  is 
generated  must  go  back  to  the  original  demand  for  medical  care.  For  measurable 
demand  to  exist  for  medical  care,  three  factors  must  be  present  in  the  attitudes  of 
the  person  seeking  care  (129):  (a)  he  must  be  convinced  he  has  a  reason  to  seek 
medical  care  or  at  least  advice;  (b)  he  must  be  able  to  find  the  care  he  seeks;  (c)  he 
must  be  convinced  the  care  will  be  worth  the  price  he  pays  for  it.  Different 
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individuals  are  likely  to  have  differing  viewpoints  on  whether  to  seek  care  in  a 
given  situation.  A  "persistent  cough"  may  be  reason  to  one  man,  but  not  to 
another.  A  two-hour  bus  ride  and  a  three-hour  wait  may  discourage  some  patients 
although  it  is  a  small  matter  to  others.  Finally,  how  much  the  patient  is  willing  to 
pay,  and  how  much  a  given  service  will  cost  him,  depends  on  a  number  of  factors 
which  change  from  individual  to  individual.  How  much  money  the  individual  has, 
whether  he  has  insurance  coverage,  or  whether  he  is  eligible  for  certain  programs 
of  free  care  will  affect  his  demand  for  health  care. 

When  the  patient  does  decide  to  seek  medical  care,  his  normal  course  of 
action  is  to  turn  to  a  doctor.  The  doctor  can  request  for  the  patient  any  of  a 
number  of  services  in  the  hospital,  through  the  hospital,  or  independently  of  the 
hospital.  Again,  which  services  he  actually  demands  depends  upon  a  combination 
of  factors,  including  his  perception  of  what  is  wrong,  the  patient's  financial  and 
social  position,  and  the  availabihty  of  services. 

Considering  the  quantity  of  health  care  rendered  to  a  community  of  people 
leads  to  the  development  of  a  long  series  of  questions  which  can  be  shown  to 
affect  the  demand  upon  the  medical  care  system.  Taken  as  a  set,  the  answers  to 
these  questions  might  describe  why  a  given  group  of  people  used  more  or  fewer 
health  care  resources,  or  received  greater  benefit  from  the  resources  than  some 
other  group.  Many  of  the  questions,  however,  are  difficult  in  themselves,  and 
further  problems  are  introduced  by  the  fact  that  the  questions  are  interlocking. 
Griffith  (129)  suggests  the  following  list  of  factors  should  be  analyzed  before 
reaching  a  full  understanding  of  demand  for  health  services  in  a  community. 
These  factors  provide  a  background  to  understand  both  the  demand  for  care  and 
quality  of  care  as  rendered  by  a  physician  or  in  an  institution  in  a  specific 
situation. 

(1)  Attitudes  of  the  people  regarding  illness  and  death,  their  interest  in 
preventing  death,  and  their  willingness  to  tolerate  illness.  These 
attitudes  include  attitudes  towards  such  matters  as  birth  control, 
abortion,  suicide,  and  aging. 

(2)  Economic  level  of  the  community  and  its  ability  to  devote  resources  to 
the  prevention  and  cure  of  illness  and  the  prolongation  of  life. 

(3)  Environmental  health  problems  such  as  the  presence  of  endemic 
infectious  disease,  environmental  pollution,  and  social,  economic  and 
genetic  factors  predisposing  to  mental  and  physical  illness. 

(4)  Morbidity,  the  actual  incidence  and  prevalence  of  disease. 

(5)  Methods  of  financing  health  care. 
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(6)  Attitudes  towards  the  seeking  of  professional  health  care,  such  as  the 
interest  of  the  population  in  seeking  periodic  physicals  for  early 
diagnosis,  prenatal  care,  or  care  of  well  infants.  Also,  the  attitude  of  the 
population  towards  the  use  of  "quacks"  and  self-diagnosis  and 
treatment. 

(7)  The  availability  of  professional  health  care,  including  primarily  doctors, 
but  also  other  health-care  professionals. 

(8)  The  attitudes  of  physicians  regarding  the  extent  of  diagnostic  services 
which  should  be  rendered,  particularly  in  regard  to  early  diagnosis  or 
secondary  prevention. 

(9)  The  attitude  of  physicians  regarding  the  selection  of  treatment, 
including  attitudes  towards  the  prolongation  of  Ufe  in  chronic  disease, 
and  attitudes  towards  the  selection  of  debatable  therapeutic  alternatives 
as  for  example,  the  use  of  psychoanalysis  versus  group  therapy  or 
chemotherapy. 

(10)  Attitudes  of  physicians  towards  the  use  of  institutional  resources,  that 
is,  the  willingness  of  physicians  to  use  hospital  services  on  outpatient 
basis,  as  well  as  the  tendency  to  admit  patients  to  the  hospital  versus 
treating  them  in  the  home  or  in  the  office. 

(11)  The  availability  of  institutional  resources,  including  not  only  the 
number  and  variety  of  hospitals  and  related  institutions  available  to  the 
population,  but  also  their  convenience,  attractiveness,  and  social, 
economic,  or  geographic  restrictions  which  might  be  imposed  on  their 
use. 

(12)  The  availability  and  adequacy  of  resources  within  the  hospital  or  other 
institution  for  diagnosis  and  treatment^ 

Griffith  (129)  emphasizes  that  the  doctor  is  the  central  figure  in  the  medical 
care  process.  He  alone  has  the  legal  authorization  to  both  diagnose  and  prescribe 
for  any  illness.  He  directly  controls  a  very  large  fraction  of  the  interaction 
between  the  citizen  and  other  professionals  and  completely  controls  the  use  of 
certain  professions  such  as  laboratory  technicians.  In  addition,  with  only  minor 
exceptions,  a  doctor  is  necessary  to  place  the  citizen  in  contact  with  any  of  the 
care  institutions. 
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It  is  with  these  portions  of  the  process,  where  the  doctor  draws  upon  the 
services  of  other  professionals  and  the  supporting  faciHties,  that  the  hospital  is 
directly  concerned.  In  general,  a  hospital  is  an  organization  of  manpower  and 
facilities  which  is  brought  into  the  process  of  medical  care  by  the  doctor.  The 
extent  of  facilities  and  services  included  in  the  hospital  varies  with  the  individual 
institution.  At  the  least,  the  hospital  will  include  an  organized  medical  staff 
relationship  with  the  doctor,  employee  relationship  to  most  of  the  allied  health 
professions  and  general  inpatient  facilities.  At  the  most,  as  exemplified  by  the 
largest  teaching  hospitals,  the  hospital  includes  employee  relationships  with  nearly 
all  the  health-care  professionals,  including  doctors,  and  all  major  forms  of 
facilities  which  deliver  care.  Regardless  of  how  large  the  scope  of  activities  of  a 
given  hospital,  its  roles  are  (a)  to  fill  the  demands  for  specific  services  made  upon 
it  by  the  individual  doctors  treating  individual  patients,  and  (b)  to  an  increasing 
degree,  to  provide  for  the  systematic  review  and  improvement  of  the  process  by 
which  the  doctor  discovers  and  meets  the  patient's  needs.  Griffith  describes  this 
process  as  the  "medical  care  process."  This  will  be  discussed  in  greater  detail  in  the 
following  section. 

Need  for  Medical  Services 

Jeffers,  et.al.  (1 58)  interpret  a  given  population's  need  for  medical  services  as 
a  normative  professional  medical  judgment  concerning  the  quantity  of  medical 
services  that  its  members  ought  to  consume  over  some  specified  time  period.  They 
define  a  given  population's  health  needs  as:  "That  quantity  of  medical  services 
which  expert  medical  opinion  believes  ought  to  be  consumed  over  a  relevant  time 
period  in  order  for  its  members  to  remain  or  become  as  "healthy"  as  is  permitted 
by  existing  medical  knowledge." 

They  go  on  to  state  that  an  accurate  specification  of  a  population's  "needs" 
for  medical  services  requires  perfect  knowledge  of  the  state  of  its  members  health, 
the  existence  of  a  well-defined  standard  of  what  constitutes  "good  health,"  and 
perfect  knowledge  of  what  modern  medicine  can  do  to  improve  ill  (or  below 
standard)  health.  It  must  be  acknowledged  that  existing  diagnostic  procedures  are 
not  capable  of  providing  perfect  knowledge  of  the  state  of  any  population's,  or 
even  of  an  individual's,  health.  It  also  must  be  acknowledged  that  a  clear-cut 
consensus  as  to  what  constitutes  "good  health"  does  not  exist  among  health 
professionals.  Further,  it  must  be  acknowledged  that  perfect  knowledge  con- 
cerning the  potential  of  modern  medicine  to  improve  ill  health  does  not  exist 
since  in  many  cases  validated  clinical  findings  verifying  the  curative  effects  of  new 
drugs  and  procedures  have  yet  to  be  accumulated.  In  spite  of  these  difficulties, 
everyday  health  professionals  are  asked  to  estimate  the  needs  for  medical  services 
of  their  patients;  and  frequently,  as  is  well  known,  panels  of  medical  experts  are 
asked  to  estimate  the  needs  for  medical  services  on  the  part  of  the  resident 
population  of  an  entire  state,  region,  or  nation.  Thus  in  spite  of  the  difficulties  of 
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doing  so,  judgments  as  to  the  quantity  of  medical  services  needed  are  made  as  a 
matter  of  course  by  medical  professionals. 

Perhaps  the  most  sophisticated  effort  to  quantify  need  was  the  study 
undertaken  by  Drs.  Roger  Lee  and  Lewis  Jones  (178).  Expressed  in  terms  of 
physician-hours  required  per  1000  persons  per  year,  these  estimates  were  made  by 
combining  the  expected  incidence  of  disease  (as  determined  from  morbidity 
studies)  with  estimates  of  the  amount  of  physician-time  required  for  prevention, 
diagnosis,  and  treatment  of  each  major  disease  according  to  prevailing  standards 
of  good  medical  practice.  Comparisons  were  later  made  by  Falk,  et.al.  (95) 
between  the  need  for  service  as  estimated  by  Lee  and  Jones  and  the  number  of 
services  actually  received  for  various  illnesses  by  different  income  groups. 

After  review  of  the  Lee-Jones  study  Ciocco,  et.al.  (41)  raised  two  points 
about  estimating  health  needs  of  a  given  population.  Lee  and  Jones  recognized 
certain  shortcomings  in  their  estimates,  particularly  the  existence  of  disease 
unrecognized  as  such  by  the  patient.  An  obvious  example  is  the  painless  lump  in 
the  breast,  often  unnoticed,  still  more  often  observed  but  disregarded,  until  it  has 
become  an  incurable  cancer.  The  first  problem  encountered,  then,  is  the  necessity 
for  complete  daita  on  the  prevalence  of  disease  in  its  broadest  sense.  There  is  at 
present  no  complete  information  of  this  sort,  and  its  collection  would  necessitate 
periodic  canvassing  combined  with  medical  examinations  on  a  large  scale. 

Another  problem  in  estimating  need  is  the  determination  of  the  amount  and 
kinds  of  the  various  medical  services  required  for  prevention,  diagnosis,  and 
treatment  of  each  disease  or  group  of  diseases.  Such  estimates  will  vary  from  place 
to  place  and  from  time  to  time,  since  methods  of  treatment  will  differ  among 
equally  authoritative  experts,  and  will  also  change  with  the  advance  of  medical 
knowledge. 

Jeffers,  et.al.  (158)  emphasized  that  in  many  cases  the  population  in 
question  may  view  its  own  health  needs  as  something  other  than  what  the  medical 
profession  views  them.  That  is,  the  quantity  of  medical  services  that  the 
population  wants  to  consume  may  be  different  from  the  quantity  of  medical 
services  the  medical  profession  feels,  in  its  opinion,  the  population's  members 
need  and  ought  to  consume. 

In  this  connection,  they  defined  a  population's  wants  for  medical  services  as: 
"That  quantity  of  medical  services  which  its  members  feel  they  ought  to  consume 
over  a  relevant  time  period  based  on  their  own  psychic  perceptions  of  their  health 
needs." 
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A  given  population's  wants  for  medical  services  depends  on  cultural, 
religious,  educational,  and  social  status  as  well  as  on  perceived  physical  or  mental 
distress.  As  such,  they  are  an  important  determinant  of  consumer  behavior,  i.e.,  a 
determinant  of  what  economists  call  demand,  a  market  phenomenon. 

Jeffers,  et.al.  (158)  elaborate  on  several  reasons  why  the  quantity  of  medical 
services  a  given  population  may  want,  may  differ  from  the  quantity  of  medical 
services  that  the  medical  profession  thinks  it  needs.  Certain  members  of  the 
population  may  be  reluctant  to  consume  some  medical  services  because  of  inertia 
or  because  their  wish  to  avoid  pain,  suffering,  or  embarrassment  which 
accompanies  their  delivery.  Uncertainty  concerning  the  potential  benefits  of 
certain  medical  services  in  connection  with  these  considerations  may  be  sufficient 
to  convince  others  that  they  do  not  want  them. 

However,  probably  the  most  important  factor  responsible  for  the  gap 
between  wants  and  needs  is  consumer  ignorance.  Most  consumers  are  ignorant  of 
professional  standards  of  what  constitutes  "good  health"  and  are  not  fully  aware 
of  the  extent  and  limitations  of  the  preventive,  therapeutic,  and  rehabihtative 
capabilities  of  modem  medicine  for  improving  their  health.  In  general,  most 
consumers  do  riot  recognize  symptoms  of  bad  health  until  they  are  manifest  as 
pain,  passage  of  blood,  or  other  obvious  abnormalities.  Further,  they  usually  defer 
seeking  out  advice  concerning  the  state  of  their  health,  or  enlightenment 
concerning  the  curative  potential  of  modern  medicine,  until  such  symptoms  are 
observed.  Even  upon  entry  into  the  health  care  delivery  system,  consumer 
enlightenment  on  these  matters  is  usually  restricted  to  knowledge  concerning  the 
specific  illness  which  prompts  them  to  seek  out  medical  care. 

As  medical  science  progresses,  more  and  more  symptoms  are  recognized  to 
be  abnormahties  associated  with  "bad  health,"  and  new  and  better  means  of 
curing  illnesses  are  developed.  As  a  consequence  of  imperfect  knowledge, 
consumer  wants  may  lag  behind  the  advances  in  standards  of  "good  health"  and 
of  the  curative  potential  of  medicine;  and,  as  a  consequence,  a  gap  may  develop 
between  health  needs  and  wants. 

However,  for  some  consumers  in  the  population,  not  all  of  whom  are 
hypochondriacs,  current  standards  of  good  health  and  curative  potential  of 
medical  technology  are  likely  to  be  below  what  they  would  like.  This  cohort 
views  its  wants  for  medical  services  as  something  greater  than  the  quantity  needed 
or  in  some  cases  even  available.  The  lower  a  given  population's  cultural, 
educational,  and  social  status,  and  the  more  restrictive  in  terms  of  the 
consumption  of  medical  services  are  its  collective  religious  beliefs,  the  greater  the 
gap  between  wants  and  needs.  However,  announcements  in  the  news  media 
concerning  the  development  of  new  drugs  and  procedures  capable  of  improving 
health,  pubhc  service  messages  concerning  the  advantages  of  preventive  health 
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measures,  and  communication  between  the  doctor  and  patient  concerning  the 
latter's  health  needs  serve  to  increase  the  population's  wants  for  medical  services, 
assuming  that  its  members  believe  what  they  read  and  hear.  However,  the  extent 
to  which  these  increased  wants  are  translated  into  increased  consumer  participa- 
tion in  the  market  for  medical  services  depends  on  certain  economic  considera- 
tions which  are  related  to  concept  of  demand  which  was  discussed  previously. 

Griffith  (129)  attacks  the  concept  of  need  from  the  standpoint  of  the 
medical  care  process  which  begins  with  the  individual  patient  seeking  the  services 
of  an  individual  physician.  The  initial  decision  to  seek  care  is  usually  the  patient's. 
All  subsequent  decisions  are  generally  those  of  this  physician,  except  that  the 
patient  may  at  any  time  terminate  his  relationship  with  his  physician  and  break 
off  the  process.  The  physician  makes  his  decisions  based  on  his  professional 
assessment  of  the  total  collection  of  patient's  needs  and  wishes.  The  medical  care 
process  may  involve  no  other  individual  or  institution.  In  fact,  for  the  great 
majority  of  the  occurrences  the  doctor  will  not  find  it  necessary  to  go  much 
beyond  the  resources  he  has  immediately  at  hand.  As  the  patient's  disease 
becomes  more  complex,  the  process  becomes  more  complicated  and  the  number 
of  additional  resources  the  doctor  will  need  increases.  The  hospital,  as  the  largest 
single  collection  of  these  resources,  soon  enters  the  medical  care  process. 

When  the  patient  presents  himself  to  the  physician,  the  doctor's  first 
decision,  usually  made  quite  automatically,  is  whether  or  not  he  will  accept  the 
patient.  In  a  few  cases,  the  doctor  may  decide  that  there  is  no  medical  need  or 
that  he  is  unable  to  serve  the  patient  and  may  discharge  him  from  the  process  at 
that  point.  The  patient  is  then  free  to  initiate  the  process  with  some  other  doctor. 
After  the  doctor  accepts  the  patient,  his  first  job  is  to  establish  a  probable 
diagnosis,  which  he  does  initially  by  careful  interview  and  examination  (history 
and  physical).  Many  specialized  diagnostic  services  are  available  to  aid  him  in 
refining  and  extending  this  diagnosis.  Laboratory  and  x-ray  are  commonly 
thought  of,  but  there  are,  in  addition,  electrocardiography,  electroencephalog- 
raphy, myography,  thermography,  and  a  growing  list  of  others.  The  next  decision 
raises  the  question  of  which  diagnostic  tests,  if  any,  the  doctor  wishes  to  use.  He 
may  then  either  provide  these  services  himself  or  order  them  from  some  outside 
resource  such  as  the  hospital.  In  either  case,  the  process  is  diverted  to  the  area  of 
diagnostic  services.  After  the  information  from  the  diagnostic  test  is  returned  to 
the  physician,  he  may  then  use  this  information  to  order  other  tests.  Thus,  the 
process  may  involve  several  repeated  episodes  of  diagnostic  testing. 

At  some  point  the  doctor  decides  that  he  has  obtained  as  much  diagnostic 
information  as  he  needs  and  then  proceeds  to  various  therapeutic  modalities.  Here 
the  doctor  can  select  therapy  based  upon  his  knowledge  of  the  diagnosis.  It  is 
possible  that,  despite  the  diagnostic  tests,  there  is  no  therapy  to  be  rendered.  In 
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this  case  the  patient  is  discharged  from  the  system.  Otherwise  the  doctor  may 
decide  a  specific  course  of  treatment  and  may  then  call  on  other  resources  to 
supply  the  treatment.  He  may  provide  it  himself  as  well.  Here  again  the  hospital  is 
frequently  the  source  of  the  service  for  the  patient. 

When  the  therapeutic  service  is  ordered,  certain  results  are  expected,  and  the 
next  step  in  the  process  involves  the  evaluation  of  whether  or  not  these  results 
were  achieved.  If  they  were  not,  the  doctor  returns  to  his  diagnosis  to  review  its 
accuracy  and  again  considers  what  therapy  should  be  ordered.  Presumably,  the 
selected  therapies  will  eventually  be  as  effective  as  was  anticipated,  and  the 
process  moves  to  the  last  decisional  areas.  Here  the  patient's  needs  are  evaluated 
in  terms  of  possible  additional  treatment  and  additional  diagnoses.  If  it  is 
indicated,  the  process  moves  back  to  a  diagnostic  or  a  therapeutic  service.  If  no 
further  treatment  is  indicated  and  no  additional  diagnosis  found,  the  patient  is 
discharged  from  the  medical  care  process. 

Griffith  (129)  summarizes  the  medical  care  process  by  purporting  that  it  is 
governed  by  the  patient  and  his  individual  physician  and  may  or  may  not  involve 
the  hospital  or  any  other  institution.  The  hospital  is  frequently  involved,  however, 
and  its  points  of  involvement  are  at  the  provision  of  diagnostic  services  and 
treatment  services.  Often  the  total  amount  of  hospital  services  which  is  required  is 
great  enough  to  warrant  physically  transferring  the  patient  to  the  hospital  and 
admitting  him  for  a  period  of  several  hours  to  several  weeks.  It  is  not  always 
necessary  that  this  be  done,  however.  Many  hospitals  provide  limited  quantities  of 
service  to  patients  on  an  outpatient  basis  or  deliver  them  to  the  patient's  home 
through  a  home  care  program. 

The  demand  upon  a  specific  service  which  results  from  a  given  patient's 
problem  is  obviously  conditioned  by  a  large  number  of  more  or  less  indepen- 
dently operating  factors,  ranging  from  social  and  environmental  factors  through 
patient-related,  doctor-related  and  disease-related  factors.  He  feels  that  two  key 
conclusions  result  from  this  fact.  The  first  is  that  "need,"  i.e.,  some  medically 
determined  condition,  is  neither  a  necessary  nor  sufficient  condition  for  demand. 
"Demand"  and  "need"  are  two  quite  different  measures  which  can  (and  should) 
be  compared,  but  never  confused.  The  second  is  that  many  of  the  factors 
affecting  demand  for  a  given  service  are  chance  or  random  factors,  so  that  it  is 
impossible  to  predict  with  certainty  that  a  specific  patient  will  need  a  service. 
Such  a  process  is  said  to  be  "stochastic,"  that  is,  subject  to  random  variation  of 
some  magnitude.  The  stochastic  nature  of  demand  and  the  difference  between 
demand  and  needs  have  profound  consequences  for  hospital  resource  planning. 
These  problems  can  almost  never  be  totally  dropped  from  consideration  in 
hospital  management  and  health  services  evaluation. 
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Relationship  of  Demand  and  Need 


As  previously  stated,  Jeffers,  et.al.  (158)  felt  that  a  given  population's  need 
for  medical  services,  from  the  standpoint  of  the  medical  profession,  relates  to  that 
quantity  of  medical  services  that  expert  medical  opinion  regards  as  available  and 
necessarily  rendered  to  enable  its  members  to  meet  contemporary  standards  of 
good  health.  This  concept  of  need  is  independent  of  economic  considerations, 
such  as  independent  of  prices  of  medical  services;  financial  resources,  including 
insurance;  and  so  on.  In  demonstrating  a  strict  connection  between  demand  and 
need,  Jeffers,  et.al.  assume  that  a  given  population  of  health  consumers  is 
perfectly  informed  concerning  contemporary  standards  of  good  health,  the 
"health  status"  of  its  members,  and  the  curative  potential  of  modern  medicine. 
They  further  assume  this  population  exhibits  no  unusual  abnormalities.  Given 
assumed  knowledge  of  contemporary  standards  of  good  health,  the  "health 
status"  of  each  of  its  members,  and  of  the  potential  of  modern  medicine  to 
diagnose  and  treat  illness,  the  hypothetical  population  has  a  very  clear  concept  of 
the  kind  and  amount  of  medical  services  it  ought  to  receive  over  a  given  time 
period,  say  a  year. 

In  this  special  case,  the  total  quantity  of  medical  services  wanted  on  the  part 
of  this  hypothetical  population  is  equal  to  the  quantity  of  medical  services  needed 
as  defined  by  the  medical  profession. 

Ciocco,  et.al.  (41)  proposed  that  four  conditions  must  be  present  to  satisfy 
this  equation. 

They  are  enumerated  as  follows.  First,  the  patient  must  not  only  recognize 
symptoms  but  must  be  aware  of  the  necessity  of  examinations  designed  to 
disclose  asymptomatic  disease.  Second,  he  must  believe  that  consultation  with  a 
physician  will  not  only  help  him,  but  will  be  the  best  value  for  his  money;  he  may 
otherwise  consult  a  naturopath,  a  druggist,  or  his  grandmother!  Third,  one  or 
more  physicians  qualified  to  treat  his  disease  must  be  geographically  and 
otherwise  available  and  must  be  known  to  or  found  by  the  patient.  Fourth,  the 
patient  must  have  the  funds,  from  one  source  or  another,  to  pay  for  the 
physician,  for  ancillary  services  and  materials,  and  for  the  hving  expenses  of  his 
family  if  incapacitation  cuts  off  his  earning  power. 

Jeffers,  et.al.  ( 1  58)  feel  the  major  question  that  arises  under  these  conditions 
is,  will  this  population  purchase  all  the  medical  services  it  wants?  The  answer  is, 
probably  not.  The  reason  is,  given  hmited  purchasing  power,  the  hypothetical 
population  cannot  purchase  all  desired  quantities  of  the  goods  and  services  that  its 
members  want.  Its  members  are  likely  to  be  aware  of  standards  of  need  for  food, 
clothing,  shelter,  recreation,  as  well  as  those  pertaining  to  medical  care.  Since  the 
collective  financial  resources  of  the  population's  members  do  not  permit  them  to 
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buy  goods  and  services  in  the  quantities  necessary  to  satisfy  all  their  wants,  they 
are,  in  the  aggregate,  likely  to  strike  some  sort  of  compromise  and  consume  less 
than  wanted  quantities  of  all  goods  and  services,  including  medical  services. 
However,  members  of  the  population  would  be  happy  to  purchase  desired 
quantities  of  those  goods  and  services  wanted  if  their  prices  were  zero.  Further, 
they  hypothesized  that  collectively,  members  of  the  population  will  buy  more  of 
any  particular  goods  or  service,  the  lower  its  price  relative  to  alternatives. 
Therefore,  at  positive  prices  for  medical  services,  the  population  is  likely  to 
consume  medical  services  in  quantities  less  than  its  total  wants.  However,  as  prices 
of  medical  services  approach  zero,  the  quantity  of  medical  services  purchased  will 
more  nearly  approximate  the  total  quantity  wanted,  where  in  this  special  case,  the 
latter  is  exactly  equal  to  the  quantity  of  medical  services  needed  as  viewed  by 
expert  medical  opinion. 

Jeffers,  et.al.  (158)  assumed  that  the  hypothetical  population  has  perfect 
knowledge  as  concerns  the  health  status  of  its  members  and  the  potential  of 
modern  medicine  for  improving  it.  They  also  assumed  the  members  of  the 
population  to  have  limited  financial  resources  and  to  have  no  unusual  acute 
medical  symptoms.  In  general,  most  consumers  have  imperfect  knowledge  of  their 
state  of  health,  contemporary  standards  of  health  care,  and  the  potential  that 
medicine  has  for  improving  it. 

Any  increase  in  information  that  a  population  receives  concerning  its  health 
status,  and  what  modern  medicine  can  do  to  improve  it,  will  shift  its  demand 
curve  for  medical  services  rightward  (an  increase  in  demand)  or  leftward  (a 
decrease  in  demand)  depending  on  how  it  affects  perceptions  of  need  for  medical 
services.  News  of  new  procedures  or  increased  knowledge  of  what  are  acceptable 
standards  of  good  health  are  Ukely  to  increase  consumer  demand  for  medical 
services. 

Similarly,  an  increase  in  financial  capacity  (increase  in  income,  insurance 
coverage,  and  so  on)  tends  to  increase  consumer  demand  for  medical  services. 

Up  to  this  point,  they  have  not  been  concerned  with  unusual  acute  care 
needs  and  demands  for  medical  services.  Under  the  conditions  assumed  above, 
consumers  may  be  assumed  to  act  rationally  and,  rather  unemotionally,  to 
allocate  dollars  among  available  goods  and  services  including  ordinary  acute, 
medical  care  services.  The  term  "rationally,"  in  this  context,  means  that 
consumers  on  the  basis  of  tastes  and  preferences,  allocate  dollars  among 
alternative  goods  and  services  taking  into  account  limited  financial  resources  and 
the  prices  that  are  associated  with  all  goods  and  services  that  are  available. 
However,  it  must  be  recognized  that  human  nature  is  such  that  people  are 
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temporarily  insensitive  to  prices  or  tend  to  discount  the  problem  of  paying  for 
their  purchases  when  they  feel  that  they  need  them  badly  enough. 

Jeffers,  et.al.  state  that,  in  an  economist's  eyes,  disregard  for  prices  and 
financial  constraints  and  failure  to  weigh  potential  benefits  in  relation  to  costs,  is 
to  act  irrationally.  Yet,  when  people  are  in  pain,  are  injured,  or  have  other 
symptoms  which  disturb  them,  and  when  ignorant  of  the  possible  causes  and 
consequences  of  these  symptoms,  they  are  prone  to  seek  out  medical  services 
without  careful  consideration  of  the  economic  consequences  of  doing  so.  Under 
these  conditions  medical  services  are  not  postponable,  people  tend  to  be 
somewhat  irrational  in  the  economist's  sense  of  the  term,  and  the  costs  and 
financial  implications  of  purchasing  expensive  medical  services  are  temporarily 
forgotten  or  given  low  priority  in  the  process  of  making  the  decision  "to  go  to  the 
doctor."  Thus,  when  extraordinary  acute  symptoms  are  manifest,  both  consumer 
demand  and  needs  may  increase. 

It  is  difficult  to  say  just  how  far  or  in  what  way  demand  increases  under 
these  conditions.  The  more  ominous  the  symptoms  and  the  more  consumers 
belie^'e  their  lives  to  be  endangered,  the  further  the  shift  in  demand.  That  is  to  say 
that  if  consumers  perceive  that  their  illness  is  a  "life  or  death"  matter,  entails 
intolerable  pain  and  suffering,  or  is  potentially  permanently  disabling,  crippling, 
disfiguring,  and  the  like,  demand  is  likely  to  coincide  or  even  surpass  actual 
medical  needs.  In  such  cases,  consumers  are  hkely  to  attempt  to  place  life  and 
limb  in  the  hands  of  physicians,  consume  all  quantities  of  medical  services  that  are 
prescribed,  and  worry  little  about  prices  and  limited  financial  capacity  with  which 
to  pay  for  services  received. 

They  emphasized  that  the  majority  of  acute  cases  do  not  involve  an 
intolerable  level  of  pain  and  suffering  or  are  not  "life  or  death"  matters;  thus  the 
times  when  consumer  demand  approaches  or  surpasses  needs  are  rare. 

Ellenbogen,  et.al.  (87)  examine  health  need  as  it  relates  to  demand  in  a 
slightly  different  context:  social  status  and  subscription  to  health  insurance.  They 
propose  that  health  insurance  has  become  a  generally  accepted  means  for  meeting 
the  costs  of  illness  in  the  American  society.  One  of  the  more  common 
explanations  of  the  subscription  to  health  insurance  has  been  based  on  the 
rationale  that  (a)  the  cost  of  medical  care  oftentimes  is  the  greatest  when  the 
breadwinner  of  the  family  is  least  able  to  pay  for  such  exigencies  and  (b)  the 
family  with  little  or  no  financial  reserve  is  frequently  unable  to  meet  the 
economic  catastrophe  of  prolonged  illness.  In  other  words,  the  rationale  is  based 
primarily  upon  the  concept  of  health  need. 
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Within  this  content,  they  presume  that  the  individual's  decision  to  subscribe 
to  health  insurance  would  increase  with  an  existing  need  or  an  anticipated  need. 
The  underlying  theory  may  be  summarized  in  three  propositions.  Persons  who 
subscribe  to  health  insurance  are  either  ( 1 )  those  who  already  know  they  have  a 
health  need  or  (2)  those  persons  who  have  certain  characteristics  which  would 
lead  them  to  believe  that  they  might  have  a  health  need  in  the  near  future, 
while  (3)  those  persons  who  conceive  only  of  a  remote  possibility  of  having  a 
health  need  would  be  the  last  to  subscribe  or  would  not  subscribe  at  all. 

However,  they  question  the  tenability  of  the  "need"  theory  on  the  basis  of 
the  limited  research  available.  While  persons  in  high  income  and  younger  age 
groups  subscribe  to  health  insurance  more  often  than  those  in  low  income  and 
older  age  groups,  they  feel  there  is  no  indication  that  the  former  two  groups  have 
greater  health  needs.  But  whether  or  not  the  need  theory  may  be  rejected  on  the 
basis  of  this  limited  research  is  problematical,  because  one  also  finds  that  the 
relationships  between  income  and  health  insurance  subscription  and  those 
between  age  and  subscription  may  have  been  reduced  by  recent  trends. 

The  preceding  discussion  leads  to  the  consideration  of  another  theory  to 
explain  the  acceptance  of  health  insurance.  This  alternative  theory  assumes  that 
status  factors  produce  differences  in  life  chances.  That  is,  the  higher  the  status, 
the  greater  the  probability  of  goals  being  achieved  and  misfortunes  being  avoided. 
The  theory  of  Ellenbogen,  et.al.  propose  that  persons  with  higher  status  subscribe 
to  health  insurance  more  than  those  with  lower  status,  and  that  persons  with  very 
low  status  seldom,  if  at  all,  subscribe. 

Based  upon  data  collected  from  a  sample  of  150  full-time  farm  operators  of 
a  western  New  York  county  in  1956,  they  formulated  two  ad  hoc  hypotheses. 
They  are:  (1)  subscription  to  health  insurance  is  a  function  of  health  need;  and 
(2)  subscription  to  health  insurance  is  a  function  of  social  status. 

Testing  of  the  proposed  hypotheses  required  that  the  decision  to  subscribe 
to  health  insurance  is  made  by  the  individual.  In  general,  they  proposed  that 
farmers  are  more  hkely  to  meet  this  condition  than  are  non-farmers.  Although 
group  insurance  plans  are  available  to  some  farmers  (particularly  through  dairy 
cooperatives,  in  that  county),  subscription  to  health  insurance  plans  was  not  a 
condition  of  employment  as  it  is  for  many  non-farm  occupations.  It  was  assumed 
that  "group  pressures,"  while  not  absent,  operated  less  prominently  at  the  time  of 
this  study  in  the  decision  to  accept  or  reject  a  health  insurance  plan  by  farmers. 

However,  to  test  the  two  general  hypotheses,  several  alternative  explanations 
required  consideration.  First,  health  need  and  status  factors  may  be  positively 
correlated,  in  which  case  the  two  overlying  theories  are  but  different  frames  of 
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reference  for  saying  the  same  thing.  Secondly,  health  need  and  status  factors  may 
be  negatively  correlated,  in  which  case  the  theories  are  mutually  exclusive;  and 
finally,  health  need  and  status  factors  may  be  neither  positively  nor  negatively 
correlated,  in  which  case  the  theories  could  be  supplementary;  that  is,  the  factors 
from  the  two  theories  could  cumulatively  contribute  to  the  explanations.  Either 
of  the  last  two  alternatives  requires  a  testing  of  each  of  the  two  general 
hypotheses. 

In  summary,  they  reported  that  the  relationship  between  health  need  and 
status  was  examined  as  well  as  the  relationship  of  each  to  the  subscription  to 
health  insurance  of  1 50  farm  operators.  In  three  tests,  health  need  factors  were 
negatively  related  to  status  factors,  and  in  three  additional  tests,  there  was  no 
significant  relationship.  These  findings  indicated  that  in  some  ways  health  need  and 
status  are  contradictory  explanations,  and  in  some  other  ways  they  could  possibly 
be  supplementary;  but  in  no  test  did  the  two  explanations  appear  to  be  merely 
two  ways  of  saying  the  same  thing. 

In  testing  the  two  general  hypotheses  for  the  explanation  of  the  subscription 
to  health  insurance,  it  was  found  that  health  need  factors  did  not  relate  to  health 
insurance  in  the  expected  direction,  and  actually  suggested  the  converse. 
Succinctly,  those  who  need  health  insurance  most  have  it  least. 

Status  factors  did  appear  to  explain  in  part  the  subscription  to  health 
insurance,  and  in  combination  they  showed  a  consistent  relationship.  Persons  with 
higher  status  more  often  subscribed  to  health  insurance.  Income,  in  particular, 
appeared  to  be  an  important  factor  in  the  controlled  analysis.  Therefore,  it  might 
be  said  that  subscription  to  health  insurance  is  more  a  function  of  ability  to  pay 
than  of  health  need,  as  defined  herein. 

The  controlled  analysis  indicated  that  further  exploration  might  be  made  of 
an  economic  model.  Obviously,  the  subscription  to  health  insurance  can  be 
interpreted  within  the  context  of  Hfe  chances,  which  is  central  to  the  theory  of 
stratification.  Since  this  concept  includes  the  avoidance  of  misfortune,  the  abihty 
to  secure  one's  family  against  excessively  high  medical  expenditures  may  provide 
a  well-defined  situation  for  testing  the  theory  of  life  chances. 

Griffith  (129)  views  the  conceptual  processes  of  need  and  demand  in  three 
categories: 

Demand  is  the  sum  of  explicit  requests  for  a  given  medical  care  service, 
either  by  the  patient  at  the  initiation  of  the  medical  care  process,  or  by  the  doctor 
acting  for  the  patient  in  the  process  of  diagnosis  and  treatment.  Some  demands 
are  implied  by  others  according  to  convention  or  hospital  policy.  For  instance,  an 
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admission  to  the  hospital  carries  an  impHed  demand  for  meals,  nursing  care,  linen, 
etc.,  as  indicated  by  the  patient's  condition  and  preestabHshed  policies.  Unless 
otherwise  stated,  these  are  treated  as  part  of  explicit  demand. 

Unexpressed  demand  is  the  demand  for  services  which  is  not  translated  to 
expUcit  demand,  usually  because  of  resource  shortages.  Examples  are  demand  for 
doctor's  services  which  are  not  expressed  because  patients  are  aware  of  long 
waiting  lists  and  requests  for  hospital  admission  not  made  because  of  crowded 
facilities,  etc.  Sometimes  such  demand  is  carried  elsewhere,  and  sometimes  it 
simply  remains  unexpressed  and  unmet.  (Unexpressed  demand  can  create  serious 
forecasting  difficulties,  for  its  existence  implies  that  historic  statistics  on  output 
under-represent  the  true  demand). 

Need  is  a  concept  of  health  services  required  by  a  population  to  maintain  it 
at  a  preconceived  level  of  health.  It  differs  from  demand  in  that: 

(1)  It  requires  a  subjective  definition  of  the  level  of  health,  the  services 
required,  or  both.  The  definitions  are  usually  supplied  by  some  medical 
authority  or  panel. 

(2)  It  excludes  those  portions  of  both  unexpressed  and  explicit  demand 
which  are  unrelated  to  the  concept  of  health  level.  For  example, 
demand  for  hospital  care  among  patients  whose  need  is  for  domicilary 
services  available  in  homes  for  the  aged  or  foster  homes  would  be 
excluded  from  a  forecast  of  the  need  for  hospital  care. 

(3)  It  includes  levels  of  health  care  (for  instance,  preventive  examinations) 
which  may  not  be  perceived  as  desirable  by  either  the  patient  or  the 
practicing  doctor,  and  thus  do  not  appear  as  either  explicit  demand  or 
unexpressed  demand. 

Of  these  three  concepts,  exphcit  demand  is  the  easiest  to  measure  and  is  the 
closest  to  output  statistics  commonly  available.  Unexpressed  demand  becomes 
important  in  the  planning  of  facilities,  because  it  often  converts  to  exphcit 
demand  when  the  barriers  imposed  by  resource  shortages  are  reduced.  It  should 
be  noted  that  the  existence  of  unmet  need  or  unexpressed  demand  does  not  imply 
a  change  in  demand  unless  the  underlying  factors  preventing  the  expression  of 
demand  are  altered.  Need  and  unexpressed  demand  are  merely  predisposing 
factors  to  changes  in  demand,  and  should  not  be  interpreted  as  automatic  in  their 
action.  Need  is  measured  only  when  agreement  is  established  on  its  definition. 
Although  the  term  has  been  commonly  used  in  the  past,  (as  in  "bed  need"  for  a 
given  community),  it  is  becoming  less  popular  with  the  realization  that  there  is 
sometimes  little  professional  consensus  to  support  a  measurement  of  need  in 
terms  of  gross  processes  like  the  medical  care  process  or  hospital  admissions,  and 
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little  practical  chance  that  demand  will  conform  automatically  to  the  need  once  it 
has  been  estimated. 

At  present,  Griffith  (129)  feels  that  one  major  use  of  "need"  evaluations  lies 
in  monitoring  the  output  of  the  various  aspects  of  medical  care  services.  He 
proposes  that  the  doctor  has  a  role  in  evaluating  need  as  well  as  demand  once  the 
medical  care  process  has  been  initiated,  and  that  one  dimension  of  the  quahty  of 
care  is  its  appropriateness.  Specifically,  the  treatment  of  the  individual  case  can  be 
judged  in  the  light  of  two  questions:  (a)  Did  this  patient  receive  all  the  diagnostic 
and  treatment  services  which  good  medical  judgment  indicates?  (i.e.,  all  he  needs, 
as  defined  by  some  medical  consensus.)  (b)  Were  all  the  services  received  by  the 
patient  indicated  by  good  medical  judgment?  (i.e.,  were  all  needed,  again  as 
defined  by  medical  consensus.) 

He  summarizes  the  distinction  between  demand,  unexpressed  demand,  and 
need,  by  describing  six  possible  states  in  which  a  patient  can  be:  (a)  with  need, 
without  demand;  (b)  with  need,  with  unexpressed  demand;  (c)  with  need,  with 
explicit  demand;  (d)  without  need,  with  explicit  demand;  (e)  without  need,  with 
unexpressed  demand;  and  (f)  without  need,  without  demand. 

Management  data  usually  are  derived  from  measurement  of  states  (c)  and  (d) 
combined  (explicit  demand,  with  or  without  need).  The  statistics  of  output, 
which  are  commonly  substituted  for  the  unknown  statistics  on  demand,  most 
closely  approximate  the  sum  of  these  two  states.  Particularly  in  situations  where 
available  facilities  are  operated  at  capacity,  output  is  likely  to  be  a  poor 
approximation  of  demand.  In  these  situations  it  is  important  to  allow  for  the 
existence  of  substantial  unexpressed  demand,  cases  (b)  and  (e).  As  consensus 
grows  among  both  doctors  and  patients  as  to  what  constitutes  "need",  cases  (d) 
and  (e)-demand  without  need-  may  be  expected  to  decline  in  importance.  At  the 
same  time,  patients  in  case  (a)  who  need  care  but  do  not  request  it  will 
presumably  perceive  their  needs  and  change  their  state  to  explicit  demand. 

Certification  of  Need 

In  1968,  Kolb  and  Sidel  (174)  reported  that  as  the  demand  for  and  the 
complexity  of  inpatient  care  increases  and  hospital  beds  become  more  and  more 
expensive  and  difficult  to  obtain,  the  efficient  use  of  hospital  beds  becomes 
increasingly  important.  The  limitation  of  length  of  stay  to  the  minimum  necessary 
for  good  patient  care  is  an  important  factor  in  the  efficient  use  of  beds.  Length  of 
inpatient  stay  in  a  general  hospital  for  patients  with  acute  diseases  is  influenced 
by  many  factors  including:  the  nature  and  severity  of  the  illness,  the  availability 
of  appropriate  facilities  for  transferring  the  patient  after  stability  has  been 
attained,  the  medical  and  social  attitudes  of  the  physician  and  patient,  and  the 
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demand  for  beds  in  the  specific  hospital  and  community.  They  felt  that  cost 
considerations  also  enter  into  decisions  on  length  of  stay,  with  hospital  stays 
being  longer  if  third  parties  are  paying  the  hospital  bill  and  shorter  if  the  patient  is 
paying  the  bill  himself.  For  this  reason,  control  mechanisms  on  length  of  stay  are 
usually  built  into  any  third-party  payment  plan. 

They  proposed  two  basic  methods  by  which  a  third-party  payer  can  attempt 
to  limit  hospital  stay.  One  of  the  most  frequently  used  limitations  on  length  of 
stay  by  third  parties  is  a  definite  time  limit  on  the  total  number  of  hospital  days 
for  which  the  patient  or  the  hospital  will  be  reimbursed.  This  method  is  indeed 
very  effective  in  limiting  length  of  stay,  but  is  extremely  arbitrary.  There  is  no 
distinction  made  between  patients  who  would  be  benefited  by  longer  stays  and 
patients  who  no  longer  need  the  benefits  of  hospitalization.  The  other  method  of 
controUing  stays  is  the  estabhshment  of  a  review  of  "medical  necessity  for 
continued  inpatient  hospitalization"  after  a  given  length  of  time.  This  method 
allows  full  consideration  of  the  medical  or  social  factors  requiring  continued 
hospitalization  but  is  of  unknown  effectiveness  in  hmiting  stay  in  those  cases  in 
which  further  stay  is  unnecessary. 

Pubhc  Law  89-97,  Title  XVIII,  Part  A,  uses  both  of  these  methods:  There 
was  absolute  Umitation  of  the  total  number  of  hospital  days  provided  within  a 
given  spell  of  illness,  and,  in  addition,  a  required  review  by  the  hospital  utilization 
review  committee  for  extended-duration  cases.  At  that  time,  the  absolute 
limitation  of  60  days  with  full  coverage  and  30  additional  days  with  $10 
coinsurance  was  very  long  and  provided  no  control  on  length  of  stay  in  the  vast 
majority  of  hospitalizations.  Therefore,  the  control  mechanism  reUed  upon  for 
most  cases  was  recertification  for  medical  necessity  by  the  physician  and  review 
by  the  Utilization  Review  Committee. 

Donabedian  (77)  appropriately  describes  (re)certification,  as  ordinarily 
carried  out,  as  a  method  of  delegated  review  and  control  rather  than  as  a  method 
of  assessment.  Usually  the  physician  in  charge  is  delegated  by  the  program  to 
decide  whether  care  is  suitable,  and  he  then  certifies  its  appropriateness.  In  effect, 
the  physician  is  being  asked  to  assess  the  appropriateness  of  his  own  care  as  well 
as  that  of  the  other  services  he  has  ordered  for  his  patient.  In  so  doing,  he  is 
expected  to  use  his  best  professional  judgment,  with  or  without  external 
guidelines  provided  by  the  program.  Thus,  he  exercises  not  only  self-control,  but 
also  control  over  the  wishes  and  propensities  of  his  client,  and,  in  controlling  any 
tendencies  for  clients  to  "abuse"  the  program,  he  functions,  in  part,  as  the  agent 
of  the  program. 
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Delegation  of  the  certification  function  is  almost  never  complete.  The 
decisions  of  the  individual  physician  are  ususally  subject  to  review  by  his 
colleagues  in  the  provision  of  care  and/or  by  his  peers  on  behalf  of  the  program 
that  finances  care. 

There  are  several  types  of  certification,  depending  on  when  in  the  course  of 
care  certification  is  required.  Initial  certification  may  take  place  before,  or  at  the 
time  of,  the  commencement  of  care.  Subsequent  certification  may  follow,  once  or 
repeatedly,  at  specified  intervals.  The  times  for  first  and  subsequent  certification 
may  be  uniform,  being  the  same  for  all  diseases,  conditions  or  types  of  care,  or 
they  may  be  variable,  being  different  for  each  disease,  condition  or  type  of  care. 

Early  Medicare  regulations  offer  an  excellent  example  of  requirement  for 
initial  certification  followed  by  recertification  at  uniform  intervals. 

Donabedian  (77)  stated  the  requirements  to  be:  The  attending  physician  or  a 
member  of  the  medical  staff  having  knowledge  of  the  case  must  state  in  writing  at 
the  time  of  admission  or  as  soon  thereafter  as  possible  the  medical  necessity  for 
the  hospital  admission.  The  first  recertification  must  be  no  later  than  the  14th 
(now  the  12th)  day  of  hospitalization.  A  second  recertification  is  required  by  the 
21st  day  (now  the  18th)  of  hospitalization,  with  subsequent  recertifications  as  of 
a  lapsed  time  set  by  the  local  utilization  review  committee,  but  at  intervals  of  no 
more  than  30  days.  At  the  option  of  the  hospital,  the  utilization  review 
committee's  review  of  extended  duration  stays  can  take  the  place  of  the  third  and 
subsequent  recertification. 

The  institution  of  uniform-interval  certification  appears  to  be  a  fairly  well 
established  procedure  in  medical  care  review.  It  is  therefore  surprising  to  see  that 
no  clear  rationale  for  the  choice  of  most  appropriate  times  at  which  certification 
is  to  be  sought  has  been  developed.  Several  studies  have  shown  that  long  hospital 
stays  are  frequently  unnecessary.  Moreover,  although  such  stays  are  relatively 
infrequent,  they  account  for  a  disproportionate  number  of  unnecessary  hospital 
days. 

Rosenfeld,  et.al.  (277)  found,  in  four  Boston  hospitals,  that  42  percent  of 
patients  who,  on  a  given  hypothetical  day  had  been  in  a  hospital  30  days  or 
longer,  did  not  require  active  hospital  care.  Furthermore,  although  such  long  stay 
cases  constituted  only  six  percent  of  discharges,  they  accounted  for  32  percent  of 
hospital  days  used  during  the  year.  A  more  recent  study  by  Van  Dyke,et.al.(345) 
showed  an  essentially  similar  picture  for  hospitals  in  New  York  City,  where  nine 
municipal  and  voluntary  general  hospitals  were  studied.  On  a  given  day,  26 
percent  of  patients  in  municipal  hospitals  and  21  percent  of  those  in  voluntary 
hospitals  were  found  to  have  been  in  hospital  for  30  days  or  longer.  Of  these 
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patients,  4 1  percent  were  judged  not  to  require  the  services  of  a  general  hospital. 
The  proportion  of  those  in  hospital  unnecessarily  was  50  percent  for  long-stay 
cases  in  municipal  hospitals.  It  varied  between  15—59  percent  for  those  in 
voluntary  hospitals,  with  an  average  of  29  percent. 

Donabedian  cited  these  figures  to  indicate  the  magnitude  of  the  problem  and 
to  explain  in  part,  why  so  much  attention  has  been  directed,  in  schemes  of 
utilization  review,  at  the  justification  for  extended  hospital  stay.  Since  the 
problem  is  even  more  serious  among  the  elderly,  the  emphasis  in  the  Medicare 
Program  is  easy  to  understand.  But  there  are  those  who  suggest  that  the  emphasis 
may  be  partly  misplaced.  Fitzpatrick  (110)  has  expressed  the  following  opinion: 
Part  of  the  reason  for  recertification  programs  is  an  unspoken  feeling  that  long 
lengths  of  stay  tend  to  involve  more  overuse  than  short  lengths  of  stay.  This  may 
be  very  far  from  the  case.  .  .  .  The  recently  published  Patterns  of  Patient  Care 
(265),  which  is  a  study  of  effectiveness  of  hospital  use,  indicates  that  a  14-day 
cutoff  point  would  miss  95.8  percent  of  the  overstays  in  appendicitis;  68.9 
percent  of  the  overstays  in  fibromyoma  of  the  uterus;  54.9  percent  of  the 
overstays  in  urinary  tract  infection;  and  37.0  percent  of  the  overstays  in  diabetes. 
Actually,  there  is  some  reason  to  believe  that  long  lengths  of  stay  tend  to  be  more 
clearly  appropriate.  This  is  because  they  are  more  likely  to  be  complicated  cases, 
which  are  more  Ukely  to  be  appropriate;  and  because  the  patient's  resources  and 
coverages  tend  to  run  out  in  the  longer  time  period,  and  greater  economic 
pressure  operates  on  the  less  sick  patients  and  their  physicians. 

He  feels  the  data  of  Riedel  and  Fitzpatrick,  while  insufficient  to  deflect 
attention  from  long-stay  cases,  serve  a  useful  purpose  in  highlighting  the  need  for 
systematic  elucidation  of  the  concepts  and  empirical  data  that  underlie  the  choice 
of  certification  intervals.  One  needs  to  determine  not  only  how  many  cases  are 
found  to  be  inappropriately  hospitalized  at  various  intervals  after  admission,  but 
also  how  many  hospital  days  would  be  "saved"  if  hospitalization  were  interrupted 
at  the  time  inappropriate  use  was  detected. 

In  view  of  the  problems  associated  with  certification  and  review  at  uniform 
intervals,  a  great  deal  of  interest  has  recently  centered  on  methods  of  variable- 
interval  certification.  With  these  methods,  the  post-admission  certification  time 
differs  according  to  diagnostic  category.  The  assumption  is  that  there  is  an  average 
appropriate  length  of  stay  for  each  diagnosis,  and  that  cases  which  stay  longer 
ought  to  be  certified  as  appropriate  and  perhaps,  in  addition,  reviewed  to 
determine  appropriateness.  Less  attention  has  been  given  to  review  of  cases  that 
stay  for  periods  significantly  shorter  than  the  average  appropriate  length  of  stay. 
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Decker  and  Bonner  (66)  have  reported  on  three  major  approaches  to  certification 
of  need  for  hospital  care : 

•  Precertification 

•  On-Site  Concurrent  Hospital  Review 

•  Hospital  Discharge  Audits 
Precertification 

They  proposed  that  precertification  is  most  appropriate  for  elective  hospital 
admissions,  but  has  been  required  for  the  continuing  care  of  emergency 
admissions  and  for  long  stays  which  exceed  originally  anticipated  norms.  Well 
known  precertification  programs  now  exist  in  Sacramento's  Certified  Hospital 
Admission  Program  (39),  Illinois'  Hospital  Admission  and  Surveillance  Program 
(143),  and  New  Mexico's  Hospital  Admission  Precertification  Program  (144). 

Precertification  may  be  performed  by  individual  physicians,  using  varied  and 
impUcit  criteria,  as  in  the  Medicare  program;  it  may  be  formalized  with  exphcit 
criteria  and  delegated  to  hospital  utilization  review  committees;  or  it  may  be 
conducted  on  a  regional  basis  by  an  intermediary,  EMCRO,  or  PSRO.  Various 
combinations  of  these  approaches  are  also  possible. 

The  objective  of  precertification  is  to  control  the  volume  of  hospital  service 
by  specific  and  Umited  prospective  authorization.  This  is  accompUshed  in  two 

ways: 

(1)  By  reviewing  the  necessity  for  hospital  admission  against  impHcit  or 
explicit  criteria  describing  indications  for  admission  for  the  most 
common  diseases; 

(2)  By  prospective  authorization  for  a  length  of  stay  based  on  empiric, 
average  regional  or  national  experience  for  that  specific  disease. 

The  source  document  for  precertification  is  always  an  application  completed 
by  the  physician  proposing  to  provide  the  service.  The  application  is  usually 
processed  by  a  trained  reviewer,  backed  by  medical  consultants;  where  explicit 
criteria  have  been  developed,  however,  precertification  could  be  largely  auto- 
mated. 
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The  value  of  precertification  programs  has  not  yet  been  fully  documented. 
The  admitting  diagnosis,  which  defines  the  needs  for  care,  may  be  hypothetical  in 
a  patient  who  presents  with  an  undiagnosed  problem.  Little  is  known  concerning 
the  effect  of  delays  introduced  by  precertification  and  possible  legal  liabilities  for 
denying  admission.  Physicians  rapidly  learn  how  to  avoid  denials  of  precertifica- 
tion. Finally,  the  cost-to-benefit  ratio  for  precertification  in  the  HASP  program 
has  been  questioned  by  a  recent  audit  (261). 

The  New  Jersey  Blue  Cross  experience  with  a  type  of  precertification  in  the 
AID  (Approval  by  Individual  Diagnosis)  deserves  detailed  mentioning.  This  model 
which  illustrates  an  approach  to  precertifying  and  reviewing  length  of  stay  at 
intervals  that  vary  according  to  diagnosis  was  instituted  by  New  Jersey  Blue  Cross 
and  Blue  Shield  in  collaboration  with  the  Medical  Society  of  New  Jersey  and  the 
New  Jersey  Hospital  Association  (146,216).  Donabedian  (77)  described  the  AID 
program  in  three  parts: 

(1)  Institution  of  standards  of  length  of  stay, 

(2)  Certification  and  recertification  of  hospital  stay,  and 

(3)  Review  of  certification  decisions. 

The  first  part  consists  of  a  determination  of  the  standards  of  length  of  stay 
which  are  considered  to  be  permissible  for  each  diagnostic  category.  The  manner 
in  which  such  standards  are  determined  is  critical  to  an  understanding  of  the 
nature  and  significance  of  this  method  of  control. 

AID  standards  are  derived  primarily  from  the  opinions  held  by  New  Jersey 
physicians  of  what  is  maximum  permissible  length  of  stay  for  specified  diagnostic 
categories.  The  data  were  obtained  by  asking  the  president  of  the  medical  staff  of 
each  participating  hospital  to  provide,  after  consultation  with  his  medical  staff,  an 
opinion  on  the  "permissible  maximum  stay,  without  complication,  [so  that] the 
physician  would  be  able  to  inform  each  patient  as  to  the  expected  maximum 
duration  of  hospitalization  benefits  (77).  The  returns  were  tabulated  and  the 
model  length  of  stay  (the  one  most  frequently  cited)  was  almost  always  used  as 
the  standard  for  AID  use.  AID  standards  are  therefore  primarily  normative  in 
derivation.  However,  the  Blue  Cross  plan  had  available  to  it  a  detailed  statistical 
analysis  of  actual  lengths  of  stay  by  diagnosis  for  all  participating  New  Jersey 
hospitals  for  a  recent  year  (1963).  These  empirical  data  were  compared  with  the 
normative  data  and  in  a  few  cases  appropriate  adjustments  of  the  standards  were 
made  in  the  light  of  actual  experience. 
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There  are  800  three-digit  diagnostic  codes  in  the  International  Statistical 
Classification.  Length  of  stay  standards  were  determined,  as  described  above,  for 
the  230  most  frequent  diagnoses.  These  accounted  for  94  percent  of  the  inpatient 
claims.  The  remaining  diagnoses  were  all  assigned  a  maximum  permissible  length 
of  stay  of  nine  days.  The  230  frequent  diagnoses  were  listed  according  to  the 
Internal  Classification  with  an  indication  of  the  standard  maximum  permissible 
length  of  stay  for  each. 

The  second  part  of  the  AID  system  is  the  certification  and  recertification  of 
hospital  stay.  On  admission  to  the  hospital,  the  patient  is  assigned  (usually  by  the 
admissions  office)  the  standard  length  of  stay  for  the  diagnosis  that  is  responsible 
for  admission.  When  there  is  more  than  one  diagnosis,  and  it  is  not  clear  which  is 
the  one  primarily  responsible  for  admission,  the  shortest  applicable  length  of 
stay  is  assigned  to  the  case.  There  is  no  need  for  the  patient's  physician  to  become 
involved  in  certification  unless  the  patient  is  still  in  the  hospital  one  or  two  days 
prior  to  the  expiration  of  the  original  and  automatic  certification.  If  the  patient  is 
not  discharged  within  this  interval,  the  physician  is  asked  to  reconsider  the  case 
and,  if  he  feels  the  patient  requires  a  longer  stay,  to  certify  to  this  effect  by  fiUing 
out  an  appropriate  form  giving  any  change  in  diagnosis,  the  approximate  number 
of  additional  days  required,  and  the  reason  for  the  extension.  One  copy  of  the 
form  is  sent  to  the  Blue  Cross  plan,  another  is  sent  to  the  utilization  review 
committee  of  the  hospital,  and  a  third  remains  in  the  patient's  hospital  chart.  This 
certification  procedure  may  be  repeated  once  or  more  at  the  times  indicated  by 
the  physician  in  the  prior  certification.  The  length  of  stay  for  which  the  plan  pays 
is  only  limited  by  the  nature  of  the  insurance  benefits  under  the  plan. 

The  third  part  of  the  AID  system,  and  one  of  critical  importance,  according 
to  Donabedian,  is  the  review  of  individual  physicians'  certification  decisions.  As 
already  described,  copies  of  recertification  forms  are  sent  to  the  insurance  plan 
and  to  the  hospital  utilization  review  committee.  It  was  expected  that  the  major 
review  and  control  function  would  be  performed  by  the  utilization  review 
committee  and  that  in  this  way,  the  hospital  staff  would  collectively  control  its 
own  practices.  In  addition,  the  Plan  was  to  review  the  completed  certification 
forms  and  call  attention  of  the  hospital  utilization  committee  to  cases  that  seem 
to  merit  further  investigation.  In  this  way,  AID  could  strengthen  utilization 
committees  by  pinpointing  administrative  areas,  diagnoses  and  physicians  where 
review  might  be  valuable. 

Donabedian  (77)  outlines  certain  features  of  the  AID  system  of  certification 
and  review  that  deserve  special  mention.  One  is  the  historical  development  of  the 
program.  Certification  was  introduced  by  New  Jersey  Blue  Cross  in  1955  with 
initial  approvals  for  28  days  and  additional  reapprovals  at  21 -day  intervals.  In 
1963,  the  period  of  initial  approval  was  cut  down  to  14  days  and  additional 
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reapprovals  were  required  at  14-day  intervals.  Approval  by  Individual  Diagnosis 
was  introduced  in  1965.  That  this  progression  may  foreshadow  a  pattern  of  more 
general  appHcability  is  suggested  by  Blue  Cross  data,  which  show  a  trend  toward 
shorter  approval  and  reapproval  intervals. 

Another  interesting  aspect  of  the  AID  program  is  the  convergence  of  forces 
that  brought  about  its  institution.  These  included  pubUc  concern  over  increasing 
hospital  cost  and  direct  pressure  from  the  insurance  commissioner  that  something 
be  done;  shortage  of  hospital  beds  in  the  face  of  a  trend  toward  longer  hospital 
stays;  fruitful  collaborative  relationships  among  the  Blue  plans,  the  medical 
society,  and  the  hospital  association;  and  strong  endorsement  by  organized  labor. 

A  third  feature  of  some  significance  is  the  manner  selected  to  bring  pressure 
to  bear  upon  the  physician  to  comply  with  the  certification  procedure. 
Theoretically,  the  physician  is  free  not  to  participate.  However,  should  he  refuse 
to  recertify  additional  days  of  stay  at  the  expiration  of  the  initial  standard  period, 
the  patient  is  informed  of  this  and  billed  directly  for  the  additional  days.  Hence, 
the  certification  procedure  is  an  attempt  to  introduce  a  reciprocal  set  of  controls 
into  the  patient-physician  relationship.  The  physician  can  use  the  certification 
requirements  to  restrain  the  patient's  desire  for  hospitalization  beyond  the  point 
of  medical  necessity,  while  the  patient,  pursuing  his  economic  interests,  can  exert 
pressure  on  the  physician  to  cooperate  with  an  essentially  administrative  process 
of  control.  Donabedian  and  Attwood  (74)  have  pointed  out  that  the  control  of 
patients  through  their  physicians,  and  of  physicians  through  their  patients, 
exemphfy  frequent  approaches  in  administrative  control  where  the  financing 
agency  has  no  means  of  exercising  more  direct  controls  over  the  parties 
concerned.  Whether  such  controls  are  effective  remains  to  be  demonstrated. 

A  fourth  feature  is  the  provision  for  review  while  the  patient  is  still  in  the 
hospital,  enabhng  the  utilization  committee,  through  proper  channels,  to  assist 
the  physician  and  administrator  in  achieving  more  appropriate  length  of  stay.  The 
significance  of  such  concurrent  review,  as  contrasted  with  the  more  usual 
retrospective  review,  will  be  discussed  in  the  following  sections.  It  has  been 
suggested  that  the  impact  of  precertification  would  be  enhanced  by  continuing 
On-Site  Concurrent  Hospital  Review. 

Decker  and  Bonner  (66)  proposed  that  precertification  programs  can  be  used 
to  evaluate  both  the  necessity  for  hospital  care  and  an  appropriate  length  of  stay. 
They  are  most  effective  when  re-enforced  by  simultaneous  On-Site  Concurrent 
Hospital  Review.  They  recommend: 

(1)   That  the  programs  emphasize  common  admission  diagnoses; 
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(2)  That  they  use  explicit  criteria  and  automated  processing,  insofar  as 
possible. 

On-Site  Concurrent  Hospital  Review 

Decker  and  Bonner  (66)  feel  that  on-site  concurrent  review  is  primarily 
appropriate  to  hospital  settings  for  two  reasons. 

(1)  The  logistics  of  providing  a  trained  reviewer  require  a  critical  mass  of 
providers  in  one  site  for  cost  justification. 

(2)  The  impact  of  this  approach  is  dependent  upon  the  support  of  an 
organized,  functioning,  and  effective  medical  staff. 

On-Site  concurrent  hospital  review  limited  to  length  of  stay  is  now  being 
conducted  in  Georgia's  Certified  Hospital  Extension  of  Care  Program  (40)  and 
Sacramento's  Certified  Hospital  Admission  Program  (39).  On-site  concurrent 
review  for  both  utilization  and  the  quality  of  care  is  now  being  performed  in 
Utah's  On-Site  Concurrent  Hospital  Utilization  Review  (235)  and  in  Multnomah 
County,  Oregon,  with  its  Concurrent  On-Site  Evaluation  and  Review  Effort  (52). 

The  objectives  of  these  current  programs  include: 

(1)  Assignment  of  a  diagnosis  specific  length  of  stay  with  appropriate 
modifications  resulting  from  continued  on-site  review  of  the  patient's 
changing  condition ; 

(2)  Concurrent  review  of  the  necessity  for  hospitaUzation,  appropriateness 
of  the  diagnosis,  relevance  of  the  investigation  and  treatment,  and  the 
quality  of  the  medical  record  by  a  trained  nurse  reviewer  supported  by 
the  hospital's  own  staff  mechanisms  and  committees; 

(3)  Use  of  the  nurse  reviewer  or  the  records  librarian  to  abstract  medical 
records,  as  they  are  completed,  for  retrospective  comparison  with 
normative  process  criteria  for  the  quahty  of  care. 

They  feel  that  on-site  concurrent  hospital  review  is  exquisitely  dependent 
upon  the  skill  and  tact  of  the  nurse  reviewer  and  upon  the  strength  of  the  hospital 
medical  staff  organization  whose  participation  makes  this  a  peer  review  program. 
It  offers  an  opportunity  to  influence  the  quahty  of  medical  care  while  it  is  being 
delivered.  Because  of  the  need  for  human  intervention,  this  approach  is 
considerably  more  expensive  than  automated  reviews. 
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On-site  concurrent  hospital  review  could  be  conducted  in  large  institutions, 
by  a  nurse  coordinator  employed  by  the  hospital  who  reports  to  the  hospital 
utihzation  review  committee.  This  approach  has  been  implemented,  in  part,  by 
New  Mexico  (144)  for  HAPP  participating  hospitals.  The  feasibihty  of  the 
program  in  small  institutions  will  depend  upon  the  use  of  a  single  nurse 
coordinator  by  multiple  hospitals  or  on  the  use  of  a  nurse  coordinator  for 
multiple  functions  in  a  single  small  hospital.  The  use  of  a  hospital  employee  to 
reduce  hospital  utilization  may  generate  a  conflict  of  interest;  resolution  may 
depend  upon  a  reorientation  of  current  hospital  objectives. 

On-site  concurrent  hospital  review,  itself,  cannot  be  automated.  Many 
opportunities  exist,  however,  for  mutual  support  between  this  program  and 
automated  programs  for  precertification  and  retrospective  hospital  discharge 
auditing. 

Decker  and  Bonner  (66)  concluded  that  on-site  concurrent  hospital  review 
can  be  conducted  in  hospitals  by  nurse  coordinators  (or  other  trained  personnel) 
employed  by  the  hospital,  or  a  group  of  small  hospitals,  reporting  to  the  hospital 
utilization  review  committee,  with  the  added  support  of  medical  advisors  on  the 
hospital  staff.  These  efforts  should  emphasize: 

(1)  Modification  of  authorized  length  of  stay,  in  relation  to  the  patient's 
changing  condition; 

(2)  Concurrent  review  of  quahty  to  influence  care  while  it  is  being 
delivered. 

Retrospective  Hospital  Discharge  Audits/Volumetric  Appraisal 

Retrospective  medical  audits,  in  hospitals,  have  been  conducted  since  1914 
by  appropriate  committees  using  case  review  techniques  and  implicit  criteria. 
Since  the  advent  of  Medicare  (Title  XVIII)  utilization  review  has  been  added  to 
quality  review  as  a  major  focus  for  these  activities. 

By  law  (Medicare)  there  are  two  aspects  of  utilization  review  required : 

(1)  Review  of  stays  of  extended  duration,  and 

(2)  Studies  of  patterns  of  care. 

Of  these  two,  the  review  of  long  stays  have  received  the  most  attention  and 
are  fully  operative  in  most  institutions. 
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A  major  deficiency  in  the  utilization  review  process  is  the  failure  of  most 
facilities  to  implement  sample  reviews,  perform  special  studies,  and  to  review 
admissions,  short  stays,  and  professional  services  that  have  been  rendered.  In 
many  cases,  facihties  do  not  recognize  the  educational  value  associated  with  these 
types  of  studies. 

As  a  result  of  their  reviews,  few  utilization  review  committees  have  made 
recommendations  relating  to  institutional  policies  and  practices  as  distinguished 
from  findings  in  individual  cases.  Many  institutions  believe  that  by  simply 
subscribing  to  a  data  service  which  compiles  statistics,  designs  profiles  and 
produces  some  comparable  data,  the  requirements  for  medical  care  evaluation  are 
met.  This  is  not  so. 

Recently,  state  agencies  and  fiscal  intermediaries  have  begun  an  effort  to  try 
to  improve  the  general  quality  of  utilization  review  and  have  placed  heavy 
emphasis  on  sample  reviews  and  special  studies.  It  is  their  feeling  that  these 
studies  are  the  most  significant  aspect  of  utilization  review  and  have  the  potential 
to  affect  improvements  in  patient  care  practices. 

In  the  early  years  of  utilization  review,  a  large  amount  of  time  was  spent 
educating  physicians  and  other  health  professionals  regarding  the  nature  and 
philosophy  of  utilization  review.  The  most  difficult  area  in  the  development  of 
the  utilization  review  process  was  in  extended  care  facilities.  These  facilities  were 
smaller  than  hospitals  and  unaccustomed  to  internal  audit  committees.  They  also 
lacked  organized  medical  staffs.  Because  of  these  problems,  the  Social  Security 
Administration  funded  several  demonstration  projects  whereby  county  medical 
societies  performed  the  review  functions  for  selected  extended  care  facilities.  This 
concept  worked  and  grew  and  now  areawide  utilization  review,  under  the  auspices 
of  a  county  medical  society,  prevails  in  many  parts  of  the  country. 

One  of  the  estimates  used  to  evaluate  utilization  of  hospital  facihties  is  the 
average  length  of  stay.  Length  of  stay  is  commonly  measured  retrospectively  by 
hospital  discharge  audit  systems.  This  evaluation  depends  upon  (66): 

(1)  The  development  of  age  specific  empiric  norms  for  length  of  stay  by 
diagnosis,  (with  or  without  surgery,  and  with  or  without  multiple 
diagnoses)  from  a  large  body  of  national  or  regional  reporting 
institutions; 

(2)  The  comparison  of  each  hospital,  service,  or  physician  with  a 
comparable  universe  selected  in  accordance  with  specified 
characteristics;  and 
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(3)  The  reporting  of  comparative  statistics,  or  exceptions  which  deviate 
from  these  norms,  for  more  intensive  hospital  review. 

The  necessity  for  admission,  including  the  vahdity  of  the  discharge  diagnosis, 
may  be  also  studied  retrospectively  by  hospital  discharge  abstract  systems. 
Available  criteria  for  this  evaluation  usually  refer  to  the  content  of  the  admission 
note,  or  the  recorded  history  and  physical  examination.  Special  training  is 
required  for  records  Ubrarians  to  be  able  to  abstract  this  information  from  the 
medical  record.  Since  the  extra  effort,  and  cost,  may  not  be  worth  the  additional 
gain,  and  since  this  facet  of  evaluation  is  perhaps  better  performed  by  prospective 
and  concurrent  methods  (previously  discussed)  Decker  and  Bonner  do  not 
recommend  this  objective  for  retrospective  audit  and  abstracting. 

Myers  and  Slee  (225)  document  the  fact  that  average  length  of  stay  can  be  a 
crude  and  misleading  statistic.  The  formula  for  average  length  of  stay  runs 
together  a  mass  of  patients  with  entirely  dissimilar  disease  conditions  that  yield  an 
unrealistic  average.  They  feel  there  is  a  need  to  bring  attention  to  length  of  stay  in 
a  different  light.  They  cite  that  PAS  indicates  that  length  of  stay  should  not  be 
Umited  to  a  single  concept,  but  should  vary  with  patient  needs  and  demands. 
Along  with  PAS,  they  suggest  the  following  as  being  significant  to  the  length  of 
stay  statistics  of  hospitals  and  extended  care  facilities: 

•  Average  Length  of  Stay  by  Service  —  An  accurate  presentation  of 
average  length  of  stay  by  service  can  assist  the  staff  and  administration 
in  their  appraisal  of  where  more  beds  are  needed  and  whether  the  stay 
of  patients  on  certain  services  can  be  safely  reduced.  This  is  particularly 
true  in  hospitals  which  are  faced  with  bed  shortages  or  in  institutions 
planning  for  expansion  of  facilities. 

•  Average  Length  of  Stay  by  Disease  Groups  —  This  type  of  information 
seems  vital  in  order  that  a  hospital  may  know  the  frequency  of  certain 
types  of  diseases  and  may  plan  facilities  and  services  accordingly.  It  is 
often  necessary  to  know  the  average  length  of  stay  according  to  broad 
diagnostic  groups.  Also,  many  times  patients  are  admitted  to  different 
services  than  they  ultimately  end  up  on,  depending  upon  the  disease 
involved. 

•  Average  Length  of  Stay  by  Age  —  It  is  recognized  that  older  patients 
generally  require  longer  periods  of  hospitahzation.  Although  there  are 
differences  in  stay  from  hospital  to  hospital  within  individual  age 
groups,  each  hospital  shows  a  progressing  increase  in  length  of  stay  for 
advancing  age.  Length  of  stay  should  be  figured  separately  for  pediatric 
and  adult  patients  as  evidence  shows  that  the  patients  under  14  years  of 
age  lower  the  average  length  of  stay  for  hospitals. 
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•  Average  Length  of  Stay  by  Sex  —  Studies  done  show  that  the  average 
length  of  stay  for  males  exceed  the  length  of  stay  for  females,  although 
the  difference  is  sHght.  The  relatively  short  stay  for  maternity  cases 
pulls  down  the  average  for  all  females. 

•  Average  Length  of  Stay  by  Specific  Disease  or  Operation  —  The  most 
information  given  by  the  average  length  of  stay  is  obtained  by 
computing  this  statistic  for  patients  with  the  same  diagnosis  or  for 
patients  upon  whom  the  same  operation  was  performed.  This  allows 
people  to  make  comparisons  of  stay  for  the  same  conditions  from  one 
time  period  to  another.  If  an  increase  or  decrease  in  the  average  length 
of  stay  is  shown  for  certain  diagnosis,  reasons  for  such  should  be 
sought.  Also,  in  computing  these  averages  deaths  should  be  excluded. 
This  is  important  with  such  diagnosis  as  acute  coronaries  where  a  large 
proportion  of  patients  die  on  the  first  hospital  day.  In  these  cases, 
adding  in  deaths  for  only  one  day  would  reduce  the  length  of 
hospitalization  average  and  obscure  the  figures  for  that  particular 
diagnosis. 

•  Average  Length  of  Stay  by  Physician  —  Of  growing  interest  to  many 
medical  staffs  is  the  variation  in  average  length  of  stay  for  the  same 
disease  according  to  the  physician  who  treats  the  patient.  This  is 
particularly  true  if  a  bed  shortage  exists  and  if  the  patients  of  some 
physicians  stay  longer  than  the  patients  of  the  remainder  of  the  medical 
staff.  A  comparison  such  as  this  can  help  reduce  the  necessary  stay  and 
make  for  more  equitable  distribution  of  beds  among  the  staff. 

•  Average  Length  of  Stay  by  Payment  —  This  category  has  growing 
interest  to  medical  and  administrative  staffs  of  hospitals  —  the  average 
length  of  stay  in  relation  to  the  payor  of  the  hospital  bill  -  due  to 
steadily  increasing  costs  of  hospitalization.  In  the  best  interest  of  all 
concerned,  the  total  days  of  hospital  stay  should  be  kept  to  the 
absolute  minimum  consistent  with  the  patient's  well  being.  It  is 
interesting  to  note  that  patients  under  both  commercial  insurance  and 
Blue  Cross  have  shorter  overall  lengths  of  stay  than  those  without 
insurance  or  those  under  some  other  plan  such  as  Workmen's 
Compensation.  To  date,  a  reason  for  this  has  not  been  documented. 

Another  parameter  of  length  of  stay  has  to  do  with  the  direct  factors 
influencing  patient's  length  of  stay.  Altman  (1)  conducted  a  study  of 
212  pairs  of  patients,  with  identical  diagnoses,  at  two  acute  hospitals  in 
an  eastern  city.  During  the  course  of  the  study,  each  pair  of  patients' 
physicians  was  interviewed  with  the  medical  record  at  hand.  The  results 
showed  that  the  following  five  factors,  other  than  clinical,  affected  the 
length  of  stay,  both  longer  and  shorter. 
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(1)  Social  and  Economic  Reasons.  Eleven  percent  of  the  total  study 
population  fall  into  this  group.  The  predominant  reasons  for  longer  length  of  stay 
were: 

•  Unsuitability  of  the  patient's  home  to  receive  him; 

•  No  one  available  to  take  care  of  him; 

•  Delay  by  the  family  in  consenting  to  consultation  while  hospitalized; 

•  Patients  desiring  to  stay  in  the  hospital  to  use  their  insurance  benefits. 
Reasons  for  shorter  lengths  of  stay  included : 

•  Patients  who  were  concerned  about  limited  or  non-existing  insurance 
benefits; 

•  Patients  who  wished  to  return  to  work  as  fast  as  possible; 

•  Patients  leaving  the  city  upon  discharge. 

(2)  Psychological  and  Emotional  Reasons.  Sixteen  percent  of  the  study 
group  fell  into  this  category.  Of  the  16  percent,  there  was  even  distribution  —  8 
percent  and  8  percent  —  of  those  with  shorter  or  longer  days.  Reasons  for  longer 
stays  included: 

•  Fear  or  fright; 

•  Those  who  needed  special  attention  and  could  not  be  trusted  at  home; 

•  Those  who  insisted  on  staying  because  they  wanted  continued  hospital 
care. 

In  the  shorter  stay  group,  reasons  included: 

•  Patients  desiring  discharge  because  of  previously  arranged  plans; 

•  Patients  who  refused  treatment; 

•  Patients  who  were  complainers  about  the  hospital  environment; 

•  Patients  who  were  alarmed  about  being  in  the  hospital  at  all. 
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(3)  Hospital  Reasons.  Six  percent  of  the  study  group  fell  into  this  category. 
There  were  no  shorter  stays  in  the  group.  The  following  reasons  were  attributed 
to  longer  stays. 

•  Waiting  for  lab  or  x-ray  results; 

•  Admission  several  days  prior  to  surgery ; 

•  Weekend  admission  with  limited  services; 

•  Unavailability  of  operating  room  at  scheduled  time. 

The  patients  in  this  category  were  younger  compared  to  the  other  categories 
and  the  overall  lengths  of  stay  were  generally  shorter. 

(4)  Physician  Reasons.  Six  percent  of  the  study  group  fell  into  this  category. 
There  were  no  instances  in  which  the  physician  admitted  being  responsible  for 
increased  length  of  stay.  The  closest  to  such  a  statement  was  related  to 
overscheduhng  of  surgical  procedures  by  individual  physicians.  For  the  most  part, 
it  was  felt  that  delay  was  due  to  other  than  the  attending  physician,  such  as 
waiting  for  a  consult  or  poor  judgment  on  the  part  of  the  house  staff. 

(5)  Other  Reasons.  Four  percent  of  the  study  group  fell  into  this  category. 
This  consisted  mainly  of  longer  stays  because  of  distance  or  transportation 
problems.  Where  transportation  was  not  a  factor,  finding  a  bed  in  another  hospital 
or  extended  care  facility  was  the  reason  for  the  delay.  In  almost  every  instance 
the  patients  falling  into  this  category  were  elderly. 

The  remaining  57  percent  of  the  study  group  had  medical  reasons  for  longer 
or  shorter  lengths  of  stay.  It  was  the  author's  (1)  opinion  that  for  the  most  part 
reasons  other  than  physical  illness  should  not  be  termed  as  "overutilization."  To 
cite  Ray  Brown  (1)  "Undoubtedly,  there  are  some  needless  uses  of  hospital  days. 
The  question  of  how  sick  is  sick  enough  to  require  hospital  care  may  increasingly 
lose  its  relevance  as  the  pubhc  becomes  increasingly  sophisticated  of  hospital 
usage.  The  pertinent  question  may  become  one  of  the  level  of  sickness  that  makes 
it  more  convenient  to  go  to  the  hospital  than  to  stay  at  home.  The  hospital  is 
regarded  as  a  life-saving  institution  by  the  public,  but  it  also  represents  a  major 
convenience.  The  chances  are  that  it  would  be  increasingly  recognized  and  utilized 
as  such  by  a  people  whose  culture  has  emphasized  the  notion  of  convenience." 

Further  factors  effecting  length  of  stay  are  discussed  by  Rosenfeld,  et.al. 
(277).  It  is  their  opinion  that  the  general  hospitals  in  this  country  will  be  utilized 
to  their  best  advantage  if  both  admission  and  length  of  stay  are  based  on  the 
patient's  need  for  services  which  cannot  be  rendered  in  any  other  type  of 
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institution,  in  an  outpatient  clinic,  or  physician's  office.  A  study  was  conducted 
of  patients  in  four  general  hospitals  staying  30  days  or  longer.  The  study  was  to 
determine  the  reasons  for  prolonged  hospitalization  and  try  to  define  factors 
affecting  hospital  utihzation.  There  were  369  patients  in  this  study.  Each  of  the 
long-stay  patients  was  evaluated  as  to  specific  requirements  for  service  on  the 
basis  of  specially  developed  criteria.  These  criteria  included  a  list  of  facilities 
performing  different  functions  and  a  list  of  patients'  characteristics  indicating 
need  for  service  in  one  of  the  various  types  of  faciUties.  The  discharge  study 
revealed  that: 

•  Six  percent  of  the  total  patients  studied  remained  in  the  hospital  30 
days  or  longer,  and  this  group  accounted  for  almost  one-third  of  the 
total  patient  days  rendered. 

•  Fifty-six  percent  of  the  long-stay  patients  required  continuing  active 
treatment  in  the  hospital. 

•  Forty-two  percent  did  not  require  hospital  care,  but  many  of  them 
needed  other  types  of  care. 

The  primary  reasons  for  keeping  these  long-stay  patients  in  the  hospital 
despite  the  fact  that  they  did  not  need  continued  active  treatment  were: 

•  Unsuitab'Jity  of  the  patient's  home; 

•  Reluctance  of  the  family  to  upset  the  patient; 

•  Lack  of  extended  care  facilities  or  services  such  as  meals  on  wheels, 
etc.,  that  the  patient  could  not  have  access  to  if  he  were  at  home. 

The  long-stay  groups  in  the  study  contained  a  large  proportion  of  elderly 
people  with  diagnoses  of  tumors  and  injuries. 

The  study  pointed  out  the  fact  that  admission  to  the  hospital  and  length 
of  stay  are  attributable  to  a  combination  of  social  factors  as  well  as  medical  ones. 
Very  often  the  medical  needs  are  overshadowed  by  the  need  of  physical  or 
psychological  shelter  and  support.  Many  times  persons  who  no  longer  require 
general  hospital  care  must  be  kept  at  the  hospital  at  total  expense  because  of 
difficulty  in  finding  a  suitable  place  or  services  for  the  patient.  The  economic 
imphcation  of  inappropriate  placement  of  patients  in  general  hospitals  or  longer 
than  medically  indicated  stays  are  grave.  Unnecessary  hospitaUzation  is  costly  in 
terms  of  dollars  spent  and  also  in  terms  of  dimension  of  resources  and  services  for 
those  who  urgently  need  the  specialized  services  of  a  general  hospital.  It  adds  to 
the  shortage  of  beds  and  may  well  raise  serious  staffing  problems.  One  thing  that 
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is  many  times  forgotten  when  speaking  of  this  subject  is  the  impact  of  a 
long-hospital  stay  on  the  patient.  This  can  have  harmful  effects  on  him,  his 
relationship  with  his  family,  the  community,  and  his  ability  to  readjust  to  life 
upon  his  return  from  the  hospital. 

The  recent  study  conducted  by  Kolb  and  Sidel  (174)  in  a  large  eastern 
teaching  hospital  established  the  hypothesis  that  utilization  review  mechanisms 
are  effective  in  changing  length  of  stay  patterns.  Their  analysis  suggests  that 
arbitrary  limitation  is  much  more  effective  than  utilization  review  but  that 
utilization  review  may  be  more  selective  in  reducing  length  of  stay.  In  the 
Imitation  method  the  hardship  is  a  financial  one,  placed  on  all  patients  staying 
beyond  the  arbitrary  period.  In  the  review  method,  it  is  a  matter  of  responsibihty 
and  reputation  for  appropriate  use  of  facihties,  placed  on  the  physician.  Since  the 
medical  necessity  for  continued  stay  up  to  a  given  point  is  usually  very  clear,  the 
effectiveness  of  the  review  mechanism  resides  in  its  abihty  to  deal  with  some  of 
the  economic  and  social  determinants  of  length  of  stay  which  begin  to  play  a  role 
after  the  clear-cut,  acute  medical  problem  has  begun  to  subside. 

Current  literature  on  length  of  stay  addresses  itself  quite  extensively  to  the 
subject  of  overuse  and  underuse  of  hospital  facilities  and  the  effect  that 
utilization  review  committees  are  having  with  respect  to  these  issues. 

Fitzpatrick  (106)  feels  that  the  appropriateness  of  hospital  utilization  is 
questioned  mainly  in  terms  of  medically  unnecessary  use  of  the  hospital.  This 
unnecessary  use  falls  into  the  following  classifications: 

•  Unnecessary  admissions 

•  Unnecessary  long  lengths  of  stay 

•  Unnecessary  treatment 

•  Unnecessary  diagnostic  procedures 

Overuse  is  emphasized  here  because  of  the  concern  over  rising  costs  but 
underuse  may  be  a  problem  as  well.  Underuse  in  terms  of  hospital  admissions 
cannot  be  discovered  unless  the  general  population  is  considered  rather  than  the 
hospitalization  population.  Hospital  stays  for  too  short  a  length  of  time  and  the 
omission  of  certain  medical  procedures  may  occur  for  a  variety  of  reasons.  They 
do  not  constitute  only  a  financial  problem,  rather  a  problem  of  quality  of  care. 
Neither  overuse  nor  underuse  can  be  discovered  or  even  defined  without  some 
concept  of  appropriateness  of  hospital  use.  Appropriateness  must  be  seen  in  a 
medical  context  in  order  to  identify  and  solve  problems  related  to  overuse  or 
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underuse.  One  of  the  purposes  of  the  hospital  utilization  committee  is  to  provide 
knowledgeable  professional  review  of  these  factors  in  hospital  use. 

Several  studies  have  been  conducted  recently  to  try  to  determine  what 
effects  hospital  utilization  review  committees  are  having.  A  recent  report  of 
utilization  review  committees  in  the  Pittsburgh,  Pennsylvania  area  reveals  that  in 
their  experience  with  utilization  committees  in  hospitals  and  extended  care 
faciHties,  they  have  achieved  the  following. 

(1)  Increased  the  awareness  of  physicians  of  their  role  in  determining 
utilization  rates. 

(2)  Resulted  in   specific  administrative  changes  designed  to  improve 
utilization  practices  at  a  number  of  hospitals. 

(3)  Improved  liaison  between  medical  staffs  and  hospital  administration 
with  respect  to  medical  administrative  problems. 

The  Pittsburgh  surveys  show  that  one  way  to  obtain  an  early  measure  of  the 
impact  of  utilization  review  committees  is  by  asking  those  connected  with  the 
activities  to  render  judgment.  Evaluation  of  utihzation  review  committees  is  a 
difficult  task.  If  it  is  assumed  that  having  a  hospital  utilization  committee  is  better 
than  not  having  one  at  all,  one  could  simply  count  the  increasing  numbers  of 
hospitals  that  have  committees  and  assure  ourselves  that  progress  is  being  made.  If 
it  is  assumed  that  having  an  active  committee  is  better  than  having  a  committee 
that  is  not  so  active,  the  hospital  can  be  surveyed  to  find  out  how  many  members 
are  on  the  committee,  how  often  they  meet,  if  they  keep  minutes,  whether  or  not 
they  interview  attending  physicians,  how  many  and  what  kind  of  medical  records 
they  review,  what  recommendations  they  have  made,  etc.  When  a  great  deal  of 
activity  is  recorded,  it  can  then  be  assumed  that  some  results  are  being  achieved; 
but  we  still  do  not  know  what  these  results  are.  Still,  it  is  important  to  try  to 
evaluate  the  work  of  the  hospital  utilization  review  committee.  If  one  wants  the 
committee  to  be  adequately  motivated  to  continue  their  work,  one  must  be  able 
to  show  them  some  accomplishment  as  concretely  as  possible.  If  they  have  no 
accomplishments,  something  may  be  wrong  with  their  methods  in  which 
comparative  achievements  of  other  hospitals  is  in  order. 

Fitzpatrick  (110)  contends  that  there  is  much  to  be  learned  about  all  facets 
of  utilization  review  that  can  only  be  learned  through  sound  research.  He 
proposes  the  following  14  points  as  being  vital  issues  to  areas  where  research 
would  improve  the  efficiency  and  effectiveness  of  review  mechanisms. 
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"(1 )  The  existence  and  meaning  of  criteria  in  medical  practice. 

(2)  Analysis  of  the  components  of  the  physician's  decision-making 
process  regarding  admissions  and  discharges. 

(3)  Methods  of  arriving  at  consensus  on  criteria  by  a  group  of  physicians. 

(4)  Variations  in  criteria  in  localities  and  regions  and  the  meaning  of  these 
variations. 

(5)  The  opinions  of  patients,  physicians,  nurses  and  administrators 
regarding  influence  of  non-medical  factors  on  hospital  use. 

(6)  Comparison  of  inpatient  medical  services  by  visiting  teams  to  review 
findings  on  the  medical  records  of  these  same  patients  following 
discharge. 

(7)  Effectiveness  and  efficiency  of  various  review  methods  such  as 
individual  versus  group  judgment,  pre-estabhshed  criteria  versus  no 
formalized  criteria,  use  of  the  medical  record  versus  use  of  an 
abstract. 

(8)  Automated  methods  of  screening  cases  for  review. 

(9)  Automated  methods  of  evaluating  cases,  in  a  preliminary  way,  which 
may  reduce  the  labor  involved  for  the  doctors  still  further. 

(10)  SimpUfied  criteria  for  evaluating  cases  —  what  are  they  and  do  they 
work?  Can  average  length  of  stay  or  average  length  of  stay  without 
complications  be  used? 

(11)  Improvement  of  the  medical  record  for  purposes  of  utilization  review. 

(12)  Effectiveness  of  various  kinds  of  utilization  review  and/or  control 
plans. 

(13)  Methods  of  measuring  and  influencing  utilization  in  extended  care 
facilities  and  tuberculosis  hospitals,  rehabilitation  units  or  hospitals, 
and  in  the  physician's  office. 

(14)  Effectiveness  with  which  the  whole  health  system  is  used  by,  or  on 
behalf  of,  the  patient  with  relation  to  an  episode  of  illness 
longitudinally  studied  (1 10)." 
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Slee  (315)  suggests  that  the  term  utilization  evaluation  be  used  for 
retrospective  review  of  admissions,  duration  of  stay,  and  professional  services 
furnished  with  regard  to  their  medical  necessity  and  efficient  use  of  facilities  and 
services.  It  is  that  segment  of  the  utilization  review  plan,  as  it  applies  to  the 
hospital,  that  is  related  to  the  internal  medical  audit. 

Appropriate  use  of  hospital  and  medical  resources  and  facilities  has  always 
been  of  concern  to  conscientious  and  thoughtful  physicians  and  hospital 
administrators.  The  medical  audit  has  always  pointed  out  excessive  use  of  drugs, 
unnecessary  hospital  stays,  and  other  wasteful  practices.  The  medical  audit  did 
not  have  its  origin,  however,  in  attention  to  the  conservation  of  resources  but 
rather  it  sprang  from  one  of  the  most  basic  drives  in  medicine,  the  drive  to 
provide  the  best  care.  Leadership  in  developing  a  methodical  approach  to 
monitoring  the  quality  of  care  and  maintaining  the  highest  standards  came  not 
only  from  the  American  College  of  Surgeons  and  the  American  College  of 
Physicians  but  also  from  hospitals  and  particularly  from  their  medical  staffs. 
Hospitals  in  1949  spurred  the  establishment  of  the  Professional  Activity  Study 
and  then  went  on  with  the  American  College  of  Surgeons  to  develop  the  Medical 
Audit  Program. 

The  medical  audit  movement  had  barely  achieved  a  good  foothold  when 
third  parties  began  to  demand  tighter  control  over  the  use  of  hospital  resources. 
Hospitals  were  asked  and  even  ordered  to  establish  utihzation  committees,  not 
primarily  to  improve  the  quality  of  care,  but  to  reduce  the  amount  of  care. 

A  number  of  utilization  committees  with  this  origin  are  in  operation.  The 
CaUfomia  Medical  Association  considers  a  hospital  utilization  committee  essen- 
tial, and  the  Tenth  Councilor  District  of  the  Pennsylvania  Medical  Society  has 
been  nationally  acclaimed  for  its  pioneering  in  this  area,  to  cite  only  two  of  the 
developments. 

Slee  (315)  quotes  J.  Everett  McClenahan,  M.D.  of  Pittsburgh  in  describing 
the  scope  of  utilization  evaluation  concerning  the  following  questions: 

"(1)  Was  the  patient's  admission  to  the  hospital  necessary? 

(2)  Has  the  treatment  of  the  patient,  while  under  medical  care,  been  carried 
out  as  expeditiously  as  possible  with  a  minimum  of  delay  in  the 
prescribed  treatment? 

(3)  Was  the  patient  discharged  as  soon  as  he  was  medically  ready?" 
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Each  of  the  questions  obviously  reflects  the  fact  that  there  are  criteria  or 
standards  for  propriety  of  admission  to  a  hospital,  speed  of  delivery  of  diagnostic 
procedures  and  treatment,  and  medical  readiness  for  discharge.  Utilization  review 
or  evaluation  requires  comparison  of  the  care  given  individuals  or  groups  of 
patients  against  these  criteria.  Since  it  is  retrospective,  this  evaluation  depends  on 
the  normal  documentation  found  in  the  clinical  records  of  discharged  patients. 

The  similarity  of  this  process  to  the  medical  audit  is  apparent.  Both  depend 
upon  comparing  medical  care  as  reflected  in  medical  records  against  standards 
representing  the  desired  care. 

But  there  are  significant  differences  between  what  utilization  evaluation 
usually  means  to  utilization  committees  and  what  medical  auditing  means  to 
American  medicine  and  hospitals.  Furthermore,  important  lessons  about  effective 
methodology  learned  in  the  medical  audit  have  not  been  applied  in  the  utilization 
committee  approach. 

A  medical  audit  is  defined  as  the  evaluation  of  the  quality  of  medical  care  as 
reflected  in  medical  records.  In  order  to  see  the  difference  between  utilization 
evaluation  and  a  medical  audit,  the  definition  of  a  medical  audit  must  be 
dissected.  The  simple  word  "quahty"  holds  the  key.  There  is  a  difference  in  scope 
between  utilization  evaluation  and  the  medical  audit. 

In  a  medical  audit,  quahty  is  defined  as  the  degree  of  conformity  with 
standards,  with  accepted  principles  and  practices.  These  desired  standards  of 
excellence  demand  that  certain  fundamental  things  be  done  for  every  patient,  that 
another  absolute  minimum  battery  of  steps  and  procedures  be  taken  for  specific 
types  of  patients,  and  finally  that  in  all  instances  investigation,  diagnosis  and 
therapy  are  tailored  to  the  individual  patient. 

The  goal  is  to  achieve  those  standards  which  each  physician  would  hke  to 
have  met  when  he  or  a  member  of  his  family  is  the  patient,  and  which  he  sincerely 
tries  to  maintain  in  his  own  practice. 

Shain  (297)  conducted  a  pilot  study  to  determine  what  types  of  cases 
require  special  efforts  to  control  utihzation.  The  approach  taken  is  defined  by  the 
following  three  steps: 

(1)  Defining  the  condition  under  study.  In  this  case,  it  became  quickly 
apparent  that  the  "disease"  which  became  known  as  over-utilization 
was  really  two  conditions  which,  although  related,  had  to  be  analyzed 
separately.  Over-utilization  may  occur  either  when  (a)  a  patient  who 
does  not  require  inpatient  diagnostic  or  treatment  services  is  admitted 
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to  the  hospital,  or  (b)  when  a  patient  is  kept  in  the  hospital  longer  than 
necessary.  Other  factors  might  also  be  considered,  such  as  excessive  use 
of  drugs  or  laboratory  tests,  during  the  hospital  stay.  The  approach  in 
this  study  was  limited,  however,  to  the  two  most  basic  components  of 
hospital  utilization,  which  are  admission  and  length  of  stay. 

(2)  Determining  the  special  characteristics  of  the  groups  in  the  population 
who  were  afflicted  with  the  condition. 

(3)  Devising  control  measures  that  were  tailored  to  the  specific  nature  of 
the  condition  and  to  the  special  characteristics  of  the  groups  that  were 
affected.  This  was  particularly  important  when  the  means  of  control  are 
scarce  or  expensive. 

Shain  (297)  reported  the  following  findings: 

Questionable  Admissions.  Forty-two  cases  (about  four  percent  of  the  total 
number  studied)  were  classified  under  this  heading,  on  the  basis  of  being  scored 
four  or  five  on  both  the  diagnostic  and  treatment  services  which  were  provided. 
This  meant  that  both  the  diagnostic  and  treatment  services  were  characterized  as 
procedures  that  could  easily  have  been  done  outside  of  the  hospital,  or  that  no 
significant  procedures  were  performed.  Seven  classes  of  patients  had  significantly 
high  proportions  of  cases  scored  as  questionable  admissions. 

By  age  and  sex,  two  groups  had  significantly  high  proportions  of 
questionable  admissions,  men  between  15  and  24  and  women  over  65.  By  reason 
for  hospitaUzation,  the  patients  admitted  apparently  for  "observation  and  or 
diagnosis"  and  for  "medical  service"  had  significantly  high  rates.  Two  diagnostic 
groups,  arthritis  and  rheumatism,  and  accidents,  were  outstandingly  high.  Finally, 
when  the  attending  physicians  were  classified  as  full-time  specialists,  and  general 
practitioners  (according  to  their  listings  in  the  national  and  state  directories),  the 
patients  of  the  part-time  specialists  were  significantly  high  on  their  rate  of 
questionable  admission. 

A  number  of  classifications  of  patients  yielded  negative  results,  that  is,  no 
class  was  found  with  a  significantly  high  rate  of  questionable  admission.  The 
distance  of  the  patient's  residence  from  the  hospital,  the  patient's  birthplace, 
marital  status,  religion,  type  of  accommodation  in  the  hospital,  and  source  of 
payment  of  the  hospital  bill  were  the  classifications  which  showed  no  significantly 
high  groups. 
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Excessive  Length  of  Stay.  The  reviewing  physicians  judged  that  50  patients 
(five  percent  of  the  total)  were  in  hospital  for  periods  which  were  probably  or 
definitely  excessive. 

The  only  age  and  sex  group  with  a  significantly  high  rate  of  excessive  stay 
were  the  women  between  45  and  64  years  of  age.  By  reason  for  hospitalization, 
the  patients  admitted  for  "medical  service"  and  for  "observation  and/or 
diagnosis"  were  again  the  two  groups  with  high  rates.  By  source  of  payment  of 
the  hospital  bill,  public  assistance  clients  were  scored  as  having  excessive  stay  in 
significantly  high  proportions.  Three  diagnostic  groups,  patients  with  skin 
infections,  arthritis  and  rheumatism,  and  non-traumatic  orthopedic  conditions 
were  scored  high. 

No  significantly  high  excessive  stay  groups  were  found  when  the  patients 
were  classified  by  residence,  place  of  birth,  marital  status,  religion,  type  of 
accommodation,  or  type  of  attending  physician. 

Data  Display  and  Analysis 

Decker  and  Bonner  (66)  reported  that  during  the  past  decade,  sophisticated 
computer  techniques,  operated  by  national  or  regional  programs,  have  helped  to 
display  and  sort  the  material  for  review.  Central  reporting  by  many  institutions 
has  added  an  additional  dimension  to  the  review;  namely,  the  opportunity  for 
inter-hospital  comparison. 

Available  hospital  discharge  data  collection  systems  depend  upon  the 
information  in  a  source  document  prepared  by  the  medical  records  librarian  at  the 
time  of  discharge  or  when  the  record  is  completed.  The  amount  of  data  required 
by  each  system  is  variable,  but  a  minimum  set  of  basic  data  has  recently  been 
established  (135,145).  Computer  processing  permits  the  development  of  summary 
displays,  statistical  summaries,  and  managerial  indices.  These  data  permit 
evaluatory  comparisons  with  other  time  periods,  other  institutions  or  profes- 
sionals, and  with  accepted  process  criteria. 

Donabedian  (77)  reported  that  the  appHcation  of  data  processing  techniques 
for  administrative  appraisal,  and  control  of  utilization  and  quality  was  probably 
pioneered  (with  initial  support  by  the  Kellogg  Foundation)  by  the  Commission  on 
Professional  and  Hospital  Activities  (CPHA)  in  Ann  Arbor,  Michigan.  CPHA  is  a 
non-profit  agency,  established  in  1955,  and  sponsored  by  the  American  College  of 
Physicians,  the  American  College  of  Surgeons,  the  American  Hospital  Association, 
and  the  Southwestern  Michigan  Hospital  Council.  Its  subscriber  hospitals,  of 
which  there  are  over  1200,  are  offered  a  variety  of  services,  including  the 
Professional  Activity  Study  (PAS),  the  Medical  Audit  Program  (MAP),  and  the 
Length  of  Stay  (LOS)  Package.  A  more  recent  example,  partly  patterned  on  PAS, 
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is  the  Hospital  Utilization  Review  Project  (HUP),  cosponsored  by  the  Allegheny 
County  Medical  Society  Foundation  and  the  Hospital  Council  of  Western 
Pennsylvania,  and  supported  by  the  Blue  Cross  of  Western  Pennsylvania.  He  uses 
these  two  agencies  (CPHA  and  HUP)  as  the  model  for  the  description  of  statistical 
display  and  analysis.  His  intent  is  to  convey  a  sense  of  the  general  applicability  of 
this  approach  rather  than  to  endorse  specific  models. 

The  critical  components  of  a  system  of  statistical  display  and  analysis  are: 

(1)  Information  suitable  for  mechanical  or  electronic  processing, 

(2)  Data  display  and  summarization, 

(3)  Evaluation 

The  basis  for  a  fully-fledged  system  of  statistical  display  and  analysis  is, 
generally,  an  abstract  of  each  patient's  hospital  record  prepared  in  such  a  way  as 
to  permit  easy  coding  and  transcription  for  machine  or  computer  processing.  The 
nature  and  amount  of  information  abstracted  from  the  record  and  available  for 
processing,  may  vary  widely.  The  PAS  abstract,  for  example,  has  extensive 
information  on  patient  management,  including  details  of  diagnostic  workup  and 
therapy.  There  are  about  150  possible  items  of  information  in  all.  By  contrast, 
HUP  uses  a  much  simpler  abstract  with  attention  focused  mainly  on  length  of  stay 
parameters  by  type  of  operation  and  diagnosis.  These  parameters  include,  in 
addition  to  total  length  of  stay,  the  number  of  days  before  and  after  operation  or 
delivery.  Thus,  the  components  of  the  total  length  of  stay  are  subject  to 
examination. 

The  statistical  system  is  not  necessarily  restricted  to  information  in  the 
patient's  record.  It  is  possible  to  set  up  a  system  that  mechanically  combines 
information  from  a  number  of  sources  so  that  more  elaborate  analyses  can  be 
made.  Such  additional  data,  stored  in  the  computer  until  called  upon,  can  include 
more  detailed  information  concerning  subscribers  as  well  as  physician  and  hospital 
characteristics. 

The  information  in  both  PAS  and  HUP  abstracts  tend  to  concentrate  on 
documenting  length  of  stay  and  elements  of  management  (professional  activities) 
for  type  of  patient  —  categorized  by  diagnosis  and  by  nature  of  surgical 
intervention,  if  any.  There  are,  however,  a  number  of  items  of  intermediate  and 
ultimate  end  results.  These  include  death  or  survival,  the  occurrence  of  hospital 
infection  or  other  complications,  the  removal  of  diseased  or  normal  tissue  at 
operation,  transfer  to  another  hospital  or  extended  care  facility,  and  discharge 
with  approval  or  against  advice.  These  systems,  therefore,  lend  themselves  to 
monitoring  "outcomes"  such  as  these. 
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The  centralization  of  data  processing,  display  and  analysis  results  in  efficient 
operations.  The  central  agency  can  develop  expertise,  assume  leadership  in 
developing  new  techniques,  and  engage  in  promotional  and  educational  activities. 
Upon  request,  the  agency  can  help  the  individual  hospital  evaluate  the  findings 
pertaining  to  it.  The  agency  can  also,  within  limits  set  by  its  own  policies,  evaluate 
general  patterns  of  care  and  disseminate  information  concerning  methods  and 
findings.  Finally,  the  accumulation  of  a  large  amount  of  information  in  one 
location  makes  it  possible  to  summarize  patterns  of  care  for  a  large  number  of 
cases  so  that  empirical  standards  might  be  constructed  and  comparisons  made 
among  individual  or  categories  of  institutions  or  physicians. 

Data  display  and  summarization  (77)  is  the  second  major  component  in  the 
system  of  statistical  appraisal.  The  advantages  of  centralizing  this  activity  for  a 
large  number  of  hospitals  have  already  been  pointed  out  by  Donabedian  (77).  The 
first  mode  of  display  is  to  supply  listings  of  cases  and  of  their  attributes  so  that 
each  row  provides  a  coded  description  of  the  characteristics  and  management  of 
each  case.  To  facihtate  review,  the  cases  may  be  arranged  in  a  variety  of  ways. 
They  may  be  listed  by  diagnostic  category,  by  type  of  operation,  by  hospital 
service,  by  physician,  or  by  combinations  of  these.  Within  each  category,  cases 
may  be  ordered  by  length  of  stay  to  permit  easier  identification  of  aberrant  cases. 
Aberrant  cases  may  be  identified  and  listed  separately.  Thus,  there  may  be  a 
separate  Usting  for  deaths,  for  cases  with  operative  complications,  or  for  cases  in 
which  certain  examinations  were  not  performed.  Cases  falling  below  or  above 
certain  percentiles  of  a  frequency  distribution  (of  length  of  stay,  for  example)  can 
be  similarly  identified  and  listed. 

In  addition  to  listings,  there  can  be  tabulations  that  summarize  experience 
for  a  hospital,  a  hospital  department,  a  physician  or  surgeon,  a  diagnostic 
category,  an  operative  procedure,  an  age  group,  and  so  on.  The  dependent  variable 
(case  characteristic)  can  be  presented  in  several  forms:  numbers,  frequency 
distributions,  means,  percentages,  percentiles,  and  so  forth.  As  might  be  expected 
a  large  variety  of  cross  tabulations  are  possible.  In  some  cases,  certain  indexes  may 
be  constructed.  For  example,  PAS  has  constructed  a  "variety  index"  that 
indicates  the  number  of  tests  done  in  the  management  of  a  case  or  group  of  cases, 
and  an  "impact  index"  which  weights  the  number  of  tests  done  by  a  score 
representing  the  amount  of  labor  required  for  each  test. 

Evaluation  (40)  is  the  third  major  component  of  a  statistical  system  of 
appraisal.  It  is  usual  to  say  that  a  statistical  system  merely  presents  data  in  a  form 
suitable  for  rapid  perusal  and  evaluation  by  the  expert  administrator  and 
physician.  For  example,  the  Commission  on  Professional  and  Hospital  Activities  is 
very  careful  to  point  out  that  its  role  is  merely  "to  increase  the  accessibiUty  of 
information  contained  in  medical  records  so  that  it  can  be  used  to  greater 
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advantage  in  the  improvement  of  patient  care"  (77).  Donabedian  feels  this  is  true, 
but  only  in  part.  In  selecting  items  of  information  for  inclusion  in  the  system,  in 
presenting  and  analyzing  data,  and  in  providing  bench  marks  and  comparative 
data,  the  statistical  system  helps  direct  evaluation  into  certain  channels,  thereby 
influencing  it.  But  the  final  decision  as  to  whether  what  shows  up  in  that 
statistical  material  is  "good"  or  "bad,"  acceptable  or  unacceptable,  remains  with 
the  hospital  and  its  staff. 

The  appropriate  hospital  authorities  interpret  the  patterns  of  care  in  their 
hospital  by  using  commonly  accepted  notions  of  what  is  suitable  care.  Questions 
may  be  raised  about  the  diagnosis  of  myocardial  infraction  without  the 
performance  of  certain  diagnostic  tests,  about  reports  of  positive  laboratory  tests 
without  evidence  of  follow-up,  or  concerning  excessively  long  stays  without 
apparent  reason  deducible  from  the  data  in  the  abstract.  All  these  judgments 
involve  the  appHcation  of  accepted  notions  of  what  is  good  practice  (normative 
standards). 

Statistical  data  also  lend  themselves  to  comparisons  among  physicians  and 
institutions,  and  the  identification  of  deviance  from  the  average  for  a  group  of 
physicians  or  institutions.  This  is  the  unique  contribution  of  evaluation  by 
statistical  display  and  analysis.  Further  refinements  can  be  made  by  comparing 
Uke  with  Hke.  PAS  uses  various  characteristics  to  group  hospitals  in  a  manner 
most  suited  to  the  question  at  hand.  Hospitals  are  frequently  grouped  by  number 
of  discharges  into  four  categories:  small,  medium  small,  medium  large,  and  large. 
Other  classificatory  criteria  include  teaching  status,  facilities  available  and 
geographic  location. 

HUP  prepares  hospital  "profiles"  which  show  graphically  the  rank  of  each 
hospital,  within  an  array  of  all  hospitals  in  the  community,  in  average  length  of 
stay  for  a  number  of  selected  medical  and  surgical  conditions,  further  indicating 
whether  the  hospital  has  risen  or  fallen  in  rank  since  the  previous  time  period.  The 
CPHA  "Length  of  Stay  Package"  shows  the  average  length  of  stay  by  diagnostic 
category  in  a  given  hospital,  the  average  length  of  stay  for  matching  patients  in  a 
standard  population  of  discharges,  the  difference  between  each  pair  of  lengths  of 
stay,  and  whether  the  difference  is  significant.  This  CPHA  tabulation  is  based  on  a 
method  that  permits  standardization  of  length  of  stay  by  diagnosis,  age,  whether 
an  operation  has  been  performed  and  whether  there  is  a  scondary  diagnosis.  Such 
comparative  studies  constitute  the  application  of  empirical  standards,  and 
represent  the  major  contribution  of  a  method  of  statistical  display  and  analysis  to 
evaluation.  Donabedian  (77)  feels  that  certain  aspects  of  evaluation  through 
statistical  display  and  analysis  deserve  special  mention.  First,  it  is  important  to 
examine  frequency  distributions,  as  well  as  averages,  when  evaluating  the  data. 
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A  second  point  is  to  emphasize  that  deviation  from  the  statistical  average 
does  not  automatically  mean  something  is  wrong.  The  average  should  not  be 
equated  with  the  good.  Deviations  merely  draw  attention  to  phenomena  that  may 
require  more  careful  examination. 

A  third  issue  is  the  nature  of  primary  emphasis  in  the  system:  whether  on 
quality  or  on  utilization.  He  has  indicated  that  the  primary  emphasis  in  HUP  is  on 
justification  of  admission  and  length  of  stay.  By  contrast,  PAS-MAP  includes 
consideration  of  many  more  aspects  of  management.  Thus,  the  difference  may  be 
seen  as  one  of  degree  rather  than  kind.  Concern  with  length  of  stay  may  be 
considered  to  represent  interest  in  one  of  the  many  dimensions  of  quality.  As 
more  information  is  collected  and  evaluated,  the  appraisal  of  quality  becomes 
multidimensional  and  therefore  more  meaningful  and  definitive. 

A  fourth  issue  is  whether  the  purpose  of  evaluation  is  to  identify  individual 
error  or  wrongdoing,  or  to  discover  institutional  patterns  that  require  changes  in 
administrative  procedure  or  organization.  Which  approach  is  emphasized  depends 
on  part  on  what  one  believes  explains  medical  behavior  in  organizations.  He 
reports  that  Shindell  (77)  has  stressed  that  length  of  stay  in  a  hospital  is 
determined  partly  by  accepted  modes  of  practice  shared  by  the  majority  of  the 
medical  staff,  and  partly  by  administrative  and  organizational  features  of 
pervasive  influence  over  which  the  individual  physician  has  limited  control. 
Excessive  average  lengths  of  stay  are  rarely  said  to  be  the  doing  of  a  few 
"offenders".  Hence,  the  emphasis  in  analysis  and  action  is  on  institutional 
performance  rather  than  the  performance  of  the  individual  physician.  On  the 
other  hand,  analysis  of  PAS  data  has  clearly  disclosed  aberrant  physician,  as  well 
as  institutional,  behavior  indicating  the  need  to  observe  the  practice  of  individual 
physicians  in  addition  to  that  of  institutions.  Thus,  the  two  approaches,  far  from 
being  mutually  exclusive,  are  reciprocally  reinforcing.  It  is  apparent  that 
individual  performance  should  be  observed  and  studied.  The  group  behavior  of 
physicians,  and  the  administrative  and  organizational  factors  that  influence  this 
behavior,  are  also  of  importance.  Choice  of  emphasis  in  any  given  situation  is 
often  a  matter  of  policy  and  strategy. 

Finally,  it  should  be  clear  that  statistical  display  and  analysis  is  often  only  a 
step  in  an  evaluative  sequence,  and  does  not  represent  the  entire  sequence.  Often, 
the  next  step  consists  of  a  more  intensive  study  of  case  records,  as  the  statistical 
system  may  reveal  pervasive  patterns  that  require  investigation  and  correction.  An 
unusually  long  average  preoperative  stay  may  bring  about  the  examination  of  a 
representative  sample  of  cases  in  order  to  determine  the  reason  which  may  be 
insufficient  preadmission  work-up,  delays  in  ordering  tests  or  receiving  their 
results,  or  problems  of  scheduling  in  the  operating  room.  Shindell  (77)  has 
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emphasized  that  the  study  of  cases  will  often  lead  to  further  administrative  and 
organizational  studies  designed  to  elucidate  the  problem  and  bring  about 
appropriate  action.  The  HUP  (77)  program  is  in  fact,  seen  to  include  the  more 
extensive  sequence  indicated  in  the  following  steps: 

(1)  Abstracting  the  medical  record  in  a  form  suitable  for  automatic  data 
processing, 

(2)  Using  data  processing  to  compile  statistics  on  hospital  use, 

(3)  Summarizing  comparative  experience  for  specific  categories  of  patients, 

(4)  Constructing  a  profile   for  a  hospital  by  reflecting  comparative 
experience  in  a  number  of  diagnostic  categories, 

(5)  Instituting  case  reviews  in  the  specific  areas  of  abnormal  experience  to 
identify  practices  and  procedures  deserving  further  investigation,  and 

(6)  Performing  special  studies  of  administrative  and  professional  practices 
and  procedures  where  indicated. 

A  similar  sequence  of  activities  can  be  said  to  characterize  the  PAS  system, 
with  the  exception  of  step  6.  PAS  does  not  offer  to  go  into  hospitals  to  perform 
special  administrative  studies  such  as  HUP  made  of  operating  room  scheduling. 

In  addition  to  revealing  undesired  patterns  of  care,  the  statistical  system  will 
also  precisely  identify  the  aberrant  cases  so  that  attention  can  be  focused  on 
these.  One  use,  therefore,  of  the  statistical  system  is  as  a  screen  to  identify  those 
cases  that  require  more  detailed  review  by  the  audit  committee,  utihzation  review 
committee  or  other  appropriate  authority  within  the  hospital. 

Sampling 

In  utihzation  and  quality  review,  the  following  types  of  cases  have  been 
considered  to  yield  a  higher  proportion  of  improper  use  of  hospital  services  (77). 

(1)  Long  Stay  Cases.  The  agencies  involved  in  the  Hospital  Utilization 
Project  (HUP)  recommend  that  long  stay  be  defined  not  as  a  single  arbitrary 
period,  but  differently  for  each  diagnosis. 

(2)  Short  Stay  Cases.  Over  ten  percent  of  all  cases  admitted  to  general 
hospitals  are  discharged  after  one  or  two  days.  Included  among  these  cases  may  be 
a  significant  number  admitted  for  diagnosis  or  minor  surgery  which  might  have 
been  provided  as  effectively  without  admission.  Each  short-term  case  where  the 
need  for  admission  is  questionable  should  be  reviewed. 
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The  Length  of  Stay  Package  of  CPHA  hsts  individually  as  short-stay  cases  all 
those  that  are  discharged  before  the  day  on  which  the  fifth  percentile  of  that  class 
of  patients  fall.  Such  cases  are  more  Hkely  to  reflect  questionable  practice  than  do 
the  long-stay  cases  as  defined  by  CPHA.  Such  short-stay  cases  do  not  tend  to  be 
diagnostic  admissions  but  rather  patients  who  it  would  seem  should  have  had  a 
longer  hospitalization  —  or  none  at  all. 

(3)  Emergency  Admissions.  A  sample  of  "emergency"  admissions  may  be 
reviewed  in  order  to  verify  the  alleged  need  for  priority  to  hospital  admission. 
During  periods  of  bed  shortage  and  waiting  lists,  cases  may  be  reviewed  soon  after 
admission  as  a  method  of  concurrent  control  to  assure  the  best  allocation  of  a 
scarce  resource. 

(4)  Symptom  Diagnoses.  The  presumption  is  that  such  cases  have  not  been 
well  studied  prior  to  admission  to  hospital. 

(5)  Certain  Diagnostic  Categories,  Operations  and  Other  Diagnostic  or 
Therapeutic  Procedures.  These  are  selected  on  the  assumption  that  improper  use 
or  improper  management  are  frequent.  Over  a  number  of  years,  the  Commission 
on  Professional  and  Hospital  Activities  has  directed  special  attention,  sometimes 
involving  repeated  studies  and  reports,  to  the  following: 

•  Diseases  —  acute  coronary  occlusion,  stroke,  toxemia  of  pregnancy, 
adult  pneumonia,  staphylococcal  infection  in  pediatrics,  diabetes, 
bleeding  duodenal  ulcer,  acute  infant  diarrhea. 

•  Operations  —  tonsillectomy,  primary  appendectomy,  radical 
mastectomy,  hysterectomy,  tubal  ligation,  uterine  suspension,  lysis  of 
abdominal  adhesions. 

•  Procedures  —  blood  transfusions,  use  of  antibiotics,  use  of 
anticoagulants. 

(6)  Unfavorable  Outcomes  in  Which  There  Might  be  Preventability  Factors. 
These  include  case  fatality,  perinatal  mortality,  postoperative  mortality,  other 
postoperative  complications,  lacerations  at  delivery,  transfusion  reactions  and 
other  adverse  reactions  to  therapy. 

(7)  Potentially  Preventable  Conditions.  It  was  pointed  out  that  the  hospital 
care  of  potentially  preventable  conditions  provides  a  clue  to  the  adequacy  of  care 
prior  to  hospitalization.  Rheumatic  heart  disease  in  a  young  person  would  be  an 
example.  Certain  complications  of  pregnancy  and  in  the  newborn  would  also 
qualify.  Where  the  nature  of  the  program  permits  it,  the  retrospective  extension 
of  case  review  into  the  prehospital  period  would  be  highly  indicated. 

128 


Arthur  D  Little,  Inc. 


(8)  Providers  Under  Surveillance.  Certain  physicians  or  hospitals,  or  certain 
categories  of  these,  may  have  been  designated  for  special  intensive  surveillance 
because  of  a  record  of  previous  improper  use  of  services  or  the  provision  of 
inadequate  care. 

(9)  Certain  Client  Behaviors.  Complaints  by  patients  are  always  a  signal  for 
careful  case  review.  If  it  is  desired  to  extend  the  definition  of  quality,  as  one 
should,  to  embrace  nontechnical  dimensions  of  care,  other  client  behaviors  might 
also  be  cues  for  intensive  analysis.  Noncompliance  with  physician  recommenda- 
tions, such  as  leaving  the  hospital  against  advice,  would  be  one  such  event. 

Another  approach  to  the  selection  of  cases  for  review  is  to  examine  all,  or 
samples  of  all,  cases  identified  as  aberrant  or  deviant  by  some  other  component  of 
the  system  of  utihzation  and  quahty  control.  The  need  to  verify  by  review  cases 
that  have  been  certified  to  stay  in  the  hospital  beyond  specified  periods  of  time 
has  been  discussed  previously.  This  is  an  integral  part  of  the  system  of  Approval 
by  Individual  Diagnosis  (AID)  which  has  been  described  in  a  previous  section.  It 
constitutes  the  hnkage  of  case  review  with  a  system  of  certification  of  hospital 
stay.  Similarly,  case  review  may  be  linked  with  a  system  of  statistical  review. 
There  is  another  method  of  Unkage  which  focuses  on  cases  which  are  aberrant  or 
deviant  in  a  statistical  sense.  It  is  possible  to  identify  cases  that  deviate  in  terms  of 
ranges  and  percentiles,  or  standard  deviations  from  the  mean.  It  is  further  possible 
to  introduce,  as  has  been  described,  corrections  for  differences  in  several 
characteristics  that  include  diagnosis,  age,  whether  there  is  a  secondary  diagnosis. 
Wolfe  (366)  has  described  in  detail  the  development  of  a  statistical  screening 
system  of  this  type  for  one  diagnostic  category:  operations  on  the  bilary  tract. 
Using  regression  analysis,  Wolfe  was  able  to  reduce  355  variables  considered  likely 
to  influence  length  of  stay  for  this  condition  to  five  which  explained  80  percent 
of  the  variation  in  length  of  stay.  These  were  number  of  consultations,  identity  of 
the  hospital,  age,  number  of  diagnoses  during  stay,  and  whether  incision  of  the 
bile  duct  was  or  was  not  done.  Using  these  control  variables,  the  computer  can 
identify  cases  that  fall  outside  the  expected  length  of  stay.  It  is  possible  in  each 
case  to  determine  the  mean  length  of  stay  and  to  set  confidence  limits.  The 
strictness  of  the  confidence  limits  determines  the  number  of  cases  identified  as 
"questionable"  and  designated  for  further  case  review. 

By  using  Wolfe's  system,  one  could  adjust  the  sample  size  according  to  the 
degree  of  doubt  about  length  of  stay  and  depending  on  the  resources  available  for 
carrying  out  case  review.  If  it  is  desirable  to  reduce  case  review  work  to  a 
minimum,  one  selects  only  cases  in  which  the  likelihood  of  inappropriate  stay  is 
very  high  (95  percent  confidence  Umits).  On  the  other  hand,  if  one  has  the 
resources,  and  is  unwilling  to  let  cases  go  by  even  if  there  is  reasonable  doubt 
length  of  stay,  one  chooses  a  lower  confidence  limit  (68  percent).  It  is  to  be 
noted,  however,  that  the  case  review  load  increases  very  rapidly. 
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The  claims  review  procedures  of  a  health  insurance  agency  may  be 
considered  as  part  of  the  utilization  control  process.  Cases  that  are  questioned  by 
this  process,  or  are  refused  payment,  constitute  another  group  of  "high  risk"  cases 
that  are  subjected  to  case  review. 

Effect  of  Certification  and  Volumetric  Appraisal 

Donabedian  (77)  has  concluded  that  quahty  appraisal  and  utilization  review 
may  have  at  least  two  effects.  First,  the  behavior  of  physicians  in  the  management 
of  care  may  be  expected  to  change  almost  immediately  due  to  the  physician's 
awareness  that  their  practice  has  been  made  visible  to  colleagues  and  to  others, 
and  that  professional  and  administrative  supervision  is  in  force.  The  magnitude  of 
this  direct,  immediate  effect  depends  on  the  extent  to  which  physicians  are 
responsive  to  supervision  with  all  its  imphcations.  A  more  gradual  but  direct 
effect  might  be  expected  as  a  result  of  the  educational  activities  associated  with 
the  analysis  and  review  of  medical  care  patterns  and  of  specific  instances  of 
management.  The  point  is  that  a  physician's  practice  may  be  below  expectation 
partly  because  of  deficiencies  in  knowledge  that  the  review  and  appraisal  activities 
would  help  to  rectify. 

Quality  appraisal  and  utilization  review  activities  can  also  have  indirect 
effects.  These  occur  when  the  result  of  appraisal  reveals  the  need  for  changes  and 
program  modifications  can  bring  about  far-reaching  changes  in  the  quahty  of  care, 
partly  through  altering  physician  behavior  and  partly  through  other  means. 

He  has  drawn  attention  to  certain  general  features  of  the  organization  of 
medical  care  that  either  promote  or  hinder  the  effective  implementation  of 
quahty  appraisal  and  utilization  control.  Among  the  features  hindering  effective 
implementation  is  the  tradition  of  autonomy  in  private  practice,  and  the 
associated  reluctance  of  physicians  to  interfere  in  each  others'  practices  and  to  be 
publicly  critical  of  each  other.  Morehead  (77)  found  the  unwilhngness  to  be 
critical  of  colleagues  a  significant  obstacle  in  the  performance  of  certain  judges 
recruited  for  the  HIP  studies. 

The  high  degree  of  interdependence  among  physicians,  with  its  professional, 
social,  and  economic  consequences,  is  another  major  obstacle  to  implementation. 
As  Donabedian  has  pointed  out,  it  is  unrealistic  to  expect  a  physician  to  be  highly 
motivated  to  scrutinize  the  work  of  colleagues  on  whom  he  depends  for  referral. 
Nor  is  it  likely  that  a  physician  on  an  audit  committee  will  be  overly  critical  when 
he  contemplates  the  possibility  that,  as  committee  members  rotate,  he  himself 
will  be  under  scrutiny  by  the  colleague  whom  he  is  expected  to  judge.  The 
empirical  observations  reported  by  Sigmond  (308)  support  these  speculations. 
According  to  surveys  of  utilization  committee  activities  in  Western  Pennsylvania, 
a  number  of  chairmen  felt  that  committee  members  were  frequently  hampered 
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because  of  fear  of  antagonizing  chiefs  of  service  and  colleagues.  If,  in  addition,  the 
organized  hospital  staff  exercises  little  selectivity  in  granting  staff  privileges,  the 
quahty  of  care  is  likely  to  be  little  influenced  by  the  presence  of  a  formal  review 
mechanism. 

Certain  conditions  might  increase  the  effectiveness  of  patient-care  review. 
The  rise  of  specialization,  and  the  specialist's  desire  to  see  his  particular 
competence  recognized  and  institutionalized,  is  one  such  factor.  Another  is  the 
presence  of  an  effectively  organized  medical  staff  within  the  hospital.  Although 
the  central  importance  of  staff  organization  has  long  been  recognized  by  the  Joint 
Commission  on  Hospital  Accreditation  (161),  present  levels  may  not  suffice  for 
reasons  mentioned  above.  Further  organization  of  the  staff  and  increasing 
identification  with  corporate  objectives  may  be  necessary.  This  is  brought  about 
to  some  degree  by  the  creation  of  a  cadre  of  full-time  members  who  can  form  an 
effective  link  between  the  institution  (or  program)  and  the  private  practitioner. 
Full-time  status,  especially  when  buttressed  by  membership  on  the  faculty  of  a 
teaching  institution,  is  associated  with  greater  sensitivity  to  quality  in  practice, 
considerable  immunity  from  the  reciprocal  obligations  of  the  medical  market- 
place, professional  prestige,  and  administrative  leverage. 

A  final  factor  of  general  importance  is  the  level  of  professional  responsibility 
and  competence  represented  in  the  administrative  structure  of  the  institution,  or 
agency,  that  finances  or  provides  medical  care.  Just  as  physicians  must  be 
organized  in  ways  that  render  them  more  amenable  to  supervision  of  performance 
and  quality  control,  organizations  that  finance  or  provide  medical  care  must  be 
professionahzed  in  order  to  become  more  responsive  to  the  imperatives  of  quality 
practice.  Several  mechanisms  are  available  for  use:  professional  advisory  commit- 
tees; professional  health  services  administrators  who  may  or  may  not  be 
physicians;  and  full-time  professional  staff  to  perform  a  variety  of  policymaking, 
administrative,  technical,  supervisory  and  liaison  functions. 
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COST  CONTROL  METHODS  IN  HEALTH  CARE  DELIVERY 


by  Stanley  Werlin 

I.  INTRODUCTION 

This  paper  summarizes  the  state-of-the-art  of  cost  control  practices  in  health 
care  delivery,  and  has  been  prepared  as  background  material  for  the  development 
of  conceptual  prototypes  of  Professional  Standards  Review  Organizations.  The 
paper  divides  cost  control  methods  into  four  classifications  which  are  all  germane 
to  PSRO's,  with  major  emphasis  placed  on  methods  used  by  risk-bearing 
organizations,  and  within  that  section,  on  claims  review.  This  was  done  due  to  the 
concept  that  claims  review  is  related  to,  yet  separate  and  distinct  from,  the 
assessment  of  quality  and  appropriateness  of  care  which  forms  the  rationale  for 
PSRO's. 

II.  COST  CONTROL  METHODS  USED  BY  INSTITUTIONS/PROVIDERS 

A  number  of  cost  control  methods  are  available  for  use  at  the  institutional 
level  of  the  health  care  delivery  system.  Those  that  will  be  discussed  in  this 
section  include  financial  administration,  automation,  shared  services,  and  para- 
medical personnel. 

A.  FINANCIAL  ADMINISTRATION 

Two  methods  available  to  health  care  institutions  for  administration  of  cost 
control  procedures  are  budgeting  and  cost  accounting.  Since  there  is  nothing 
unique  about  the  application  of  these  two  management  tools  to  health 
institutions,  their  descriptions  will  be  brief.  Budgeting,  if  used  appropriately  for 
management  control,  can  pinpoint  areas  where  cost  control  is  needed,  while  at  the 
same  time  focuses  on  areas  where  performance  is  better  than  expected.  The 
principal  value  of  budgeting  as  a  cost  control  mechanism,  however,  is  its  ability  to 
develop  an  awareness  on  the  part  of  department  or  section  managers  about  their 
expected  performance  as  well  as  making  them  conscious  of  costs  due  to  their 
direct  involvement  in  the  budgeting  process.  Coupled  with  wise  management 
direction,  budgeting  can  exert  considerable  influence  on  costs.  More  will  be  said 
about  this  subject  as  it  relates  to  cost  control  later  in  this  paper. 

Cost  accounting  performs  essentially  the  same  function  as  budgeting  by 
generating  reports  to  management  concerning  total  costs  in  various  areas  of 
operation  and  unit  costs  for  various  services.  While  cost  accounting  exerts  no 
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direct  influence  over  department  or  section  leaders,  it  nevertheless  can  be  an  aid 
to  management  in  pinpointing  areas  of  climbing  costs  as  well  as  areas  of 
efficiency. 

B.  AUTOMATION  AND  MULTIPHASIC  SCREENING 

It  has  been  argued  by  many  authorities  that  automation  can  achieve 
significant  cost  savings  when  applied  on  an  interhospital  or  shared  basis,  and 
smaller,  but  still  meaningful  savings,  when  used  by  a  single  hospital.  Computers 
can  be  successfully  applied  to  a  health  care  institution's  business  operations, 
patient  records,  patient  monitoring,  drug  distribution  system,  diagnostic  testing, 
and  laboratory  analyses.  While  there  are  many  documented  instances  of 
cost-savings  for  each  of  the  above  applications  of  Electronic  Data  Processing  to 
health  care,  perhaps  the  most  widely  publicized  use  of  automation  in  health  care 
is  the  automated  multi-test,  diagnostic  laboratory,  generally  termed  multiphasic 
screening. 

The  process  of  multiphasic  screening  is  listed  in  this  section  because  it 
incorporates  an  array  of  cost-saving  automated  techniques(15).  It  also  serves 
another,  more  fundamental  cost  control  function  by  regulating  entrance  to  the 
physician  side  of  the  health  care  delivery  system  in  a  more  appropriate  manner 
than  by  the  traditional  price-oriented  regulation  system.  The  notion  of  a  price 
system  serving  as  a  regulator  of  market  demand  is  basic  to  the  discipline  of 
economics  and  finds  its  raison  d'etre  in  the  need  for  a  mechanism  to  allocate 
resources  among  competing  demands.  However,  this  system  of  regulation  is  less 
than  desirable  in  the  market  for  health  care.  The  physician's  fee  can  cause  people 
to  postpone  visiting  the  physician  until  they  are  actually  ill,  thus  minimizing  the 
number  of  healthy  or  early-sick  people  who  enter  the  system.  Eliminating  the  fee, 
which  is  essentially  the  effect  of  insurance  coverage  of  physician  services  or 
subscription  to  a  group  practice  prepayment  plan,  presents  the  consumer  with  a 
situation  of  zero  price  in  which  most  consumers  demand  physician  services, 
whether  they  are  well,  worried,  or  sick.  While  encouraging  people  to  visit  the 
physician  is  a  desirable  action,  the  consequent  use  of  physician  time  is  an 
undesirable  result.  A  proposed  solution  to  this  dilemma  is  to  use  multiphasic 
screening  within  a  zero  price  framework. 

The  Kaiser  prototype  of  a  multiphasic  screening  program  is  a  computerized 
medical  history  followed  by  a  series  of  physiological  tests  given  by  paramedics 
and  analyzed,  to  the  fullest  extent  possible,  via  Electronic  Data  Processing.  Based 
on  the  multiphasic  screening  test  results,  the  computer  then  decides  either  to  send 
the  patient  home,  order  further  tests,  or  arrange  an  appointment  with  a  physician. 
The  system  thus  maximizes  physician  time  for  non-routine  purposes,  maximizes 
skills  of  paramedical  personnel,  and  minimizes  hospital  use  for  diagnostic 
purposes.  Each  of  these  system  attributes  contributes  to  cost  containment  via  the 
resulting  appropriate  and  efficient  use  of  health  services. 
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C.  SHARED  SERVICES 


It  has  been  true  in  the  past  and  continues  to  be  so  today  that  in  an  urban  or 
suburban  setting  where  a  multiphcity  of  hospitals  exists  to  serve  the  same 
population  group,  each  hospital  acts  to  increase  its  own  range  of  services.  Reasons 
often  cited  for  such  behavior  include  the  needs  of  the  medical  staff,  the  needs  of 
teaching  programs,  the  philosophy  of  the  hospital  Board  of  Trustees,  community 
pride  and  expectation,  and  the  desire  to  provide  a  true  range  of  comprehensive 
services.  Nevertheless,  what  is  optimal  for  an  individual  hospital  is  not  necessarily 
optimal  for  the  entire  hospital  complex,  and  in  terms  of  controlling  health  care 
costs,  it  is  the  latter  that  is  the  key  issue  for  shared  services.  Typically  mentioned 
as  examples  of  expensive  duplicated  services  within  a  single  service  area  are 
facihties  for  open-heart  surgery  and  high-energy  radiation  therapy.  Where  such 
services  do  exist  in  excess,  they  are  underutilized  on  an  individual  basis  and  the 
aggregate  absorbed  overhead  cost  for  the  combined  hospitals  is  quite  large.  Until 
hospitals  in  close  proximity  adopt  a  system-oriented  philosophy  and  learn  to 
cooperate  to  provide  comprehensive  services  at  an  appropriate  level,  cost  control 
in  this  area  will  have  to  rely  on  public  pressure,  via  legislation  and/or  planning 
authorities  whose  recommendations  or  mandates  must  be  followed. 

While  there  are  some  types  of  services  that  every  hospital  in  an  area  need  not 
render,  there  are  also  some  that  must  be  available  to  every  hospital  which,  if 
provided  on  a  shared  basis,  can  achieve  economies  of  scale  and  consequent  cost 
savings.  These  services  include  purchasing,  lab  facilities,  medical  records,  food 
service,  laundry.  Electronic  Data  Processing,  etc.  Examples  of  cost  saving  by 
shared  purchasing  are  volume  discounts,  standardization,  and  control  of  quahty; 
for  laundry,  a  workload  large  enough  to  support  investment  in  machinery, 
reduced  inventory  levels  for  individual  hospitals,  and  space  saving  within  each 
participating  hospital;  and  for  laboratory  facilities,  economies  in  equipment, 
materials,  and  personnel,  as  well  as  reduced  costs  of  overhead  from  infrequently 
used  materials  and  testing  equipment.  There  are  similar  savings  to  be  had  in  the 
other  areas  mentioned,  again  due  to  the  fundamental  rationale  for  shared  services: 
economies  of  scale. 

D.  PARAMEDICAL  PERSONNEL 

The  notion  of  efficient  manpower  utilization  centers  on  the  appropriate  use 
of  skilled  personnel.  In  the  health  field,  where  physician  compensation  is 
extremely  high,  inappropriate  use  of  physician  services  results  in  inefficiency, 
lower  productivity,  and  ultimately  higher  costs  to  the  consumer.  Currently, 
inappropriate  use  of  physician  services  is  a  frequent  occurrence;  a  physician's  level 
of  medical  proficiency  is  not  required  for  many  of  the  services  performed  by 
physicians  today.  This  situation  continues  to  exist  for  at  least  three  reasons.  One 
is  the  very  limited  supply  of  paramedical  personnel  available  due  to  the  only 
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relatively  recent  discovery  of  their  potential  in  the  health  field.  A  second  is  that 
restrictive  hcensure  legislation  still  applies  to  paramedics,  either  by  Umiting  their 
activities  or  by  refusing  entirely  to  sanction  their  use  by  health  providers,  thus 
leading  to  the  sub-optimal  allocation  of  health  manpower  resources.  Finally, 
physician  resistance  to  paramedics  is  often  strong,  due  to  a  variety  of  reasons 
including  economic  self-interest,  the  role  a  physician  sees  for  himself  (specialist  or 
generalist),  and  the  problem  of  medical  responsibility.  Nevertheless,  the  cost 
control  potential  of  paramedics  remains  high.  Appropriate  use  of  paramedical 
personnel  can  help  to  alleviate  shortages  by  delegating  to  paramedics  the  simple, 
more  routine  physician  tasks  and  freeing  the  physician  to  handle  patients  more  in 
need  of  his  highly  skilled  level  of  training  (60).  Such  a  physician-paramedic 
tandem  ought  to  reduce  fees  for  basic  services  due  to  the  lower  compensation 
levels  of  paramedics,  or,  if  applied  in  a  group  practice  setting,  increase  the 
comprehensiveness  of  benefits,  which  if  properly  utilized  simply  amounts  to 
another  form  of  cost  control. 

III.  COST  CONTROL  METHODS  USED  BY  RISK-BEARING 
ORGANIZATIONS 

The  emergence  of  the  health  insurance  industry  after  World  War  II  and  the 
phenomenal  growth  in  population  covered  by  some  form  of  health  insurance, 
coupled  with  the  alarming  escalation  of  health  care  costs  over  the  past  decade,  has 
fostered  a  strong  concern  for  and  commitment  to  cost  control  on  the  part  of 
third-party  payers.  A  myriad  of  cost  control  techniques  aimed  at  the  consumer, 
the  physician,  and  the  hospital  have  been  developed  and  implemented  with 
varying  degrees  of  success.  This  section  wUl  discuss  the  following  methods  of  cost 
control:  for  the  consumer,  cost-sharing;  for  physicians,  UCR,  fee  schedules,  and 
relative  value  schedules;  for  hospitals,  Medicare,  Blue  Cross  and  inclusive  rate 
reimbursement;  and  for  both  hospitals  and  physicians,  claims  review.  In  addition, 
current  and  recent  experiments  in  incentive  reimbursement  will  be  discussed. 
Special  emphasis  will  be  placed  on  models  of  the  claims  review  process  due  to  that 
method's  particular  relationship  to  assessment  of  quaUty  and  appropriateness  of 
care. 

A.  COST  SHARING 

Cost  sharing  is  a  cost  control  technique  directed  at  the  purchaser  of  a  health 
insurance  policy  and  is  designed  to  force  the  consumer  to  pay  for  part  of  his 
health  care  under  certain  circumstances.  The  basic  purpose  of  cost-sharing  is  to 
reduce  expenditures  and  inappropriate  utiUzation  through  the  reduction,  and 
hopefully,  elimination,  of  moral  hazard,  i.e.  the  tendency  for  people  to  act  as  if 
the  price  of  medical  care  were  zero  due  to  the  presence  of  insurance  coverage,  and 
therefore,  to  demand  more  care  than  if  they  were  not  insured  (50).  Cost-sharing 
may  take  four  forms,  deductible,  coinsurance,  copayment,  and  indemnity.  A 
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deductible  clause  in  a  policy  states  that  the  cost  of  care  up  to  a  certain  fixed 
dollar  amount  must  be  paid  by  the  patient.  Coinsurance,  or  percentage 
participation,  refers  to  the  patient's  obligation  to  pay  for  a  certain  percentage  of 
his  care.  Copayment,  in  contrast,  means  that  the  consumer  must  contribute  a 
certain  fixed  sum  toward  his  bill.  Both  coinsurance  and  copayment  usually  apply 
to  that  portion  of  a  claim  remaining  after  application  of  the  deductible.  Finally, 
the  concept  of  indemnity,  while  not  usually  thought  of  as  a  cost-sharing  method, 
can  be  used  for  that  purpose.  An  indemnity  schedule  sets  a  certain  sum  to  be  paid 
directly  to  the  consumer  depending  on  what  services  were  received.  By  setting  the 
reimbursable  amounts  at  less  than  full  payment  for  the  services  rendered,  the 
insurance  company  can  effectively  impose  cost-sharing  on  the  consumer. 

Cost-sharing  as  a  cost  control  technique  is  rationahzed  in  three  ways.  First,  it 
is  claimed  that  it  reduces  the  cost  of  insurance  premiums.  Although  this  seems 
intuitively  true,  the  additional  administrative  expenses  incurred  with  cost-sharing 
cast  some  doubt  on  the  statement's  validity.  In  addition,  even  if  the  statement 
were  true,  taken  by  itself  it  says  nothing  about  reducing  total  costs  to  the 
consumer.  The  essence  of  this  claim  is  really  that  cost-sharing  is  used  for 
marketing  purposes  more  than  cost  control  purposes.  Second,  it  reduces  a 
potentially  large  volume  of  small  claims  handling  if  a  deductible  is  used.  Third,  it 
may  reduce  unnecessary  utilization  (moral  hazard).  The  effectiveness  of  cost- 
sharing  as  a  cost  control  technique  depends  in  large  part  on  the  validity  of  the 
third  argument. 

A  number  of  studies  have  been  conducted  from  which  it  is  possible  to  draw 
some  conclusions  about  the  effect  of  cost  sharing  on  hospital  utihzation.  Diokno 
(31)  found  in  a  study  of  an  indemnity  insurance  plan  versus  a  full  coverage  plan 
that  utihzation  was  higher  under  the  full  coverage  plan,  thus  lending  support  to 
the  critical  argument  discussed  earlier.  A  study  of  the  Blue  Cross  of  Virginia  (50) 
showed  that  the  addition  of  cost-sharing  provisions  to  subscriber  contracts 
reduced  utilization.  A  comparison  of  Blue  Cross  plans  (170),  some  of  which  had 
cost-sharing  provisions  and  some  of  which  did  not,  found  lower  utilization  among 
those  with  cost-sharing.  In  a  study  of  alternate  contracts  provided  by  Michigan 
Blue  Cross,  one  providing  full  coverage  and  the  other  featuring  deductible 
provisions,  much  lower  utilization  by  subscribers  of  the  latter  contract  was 
discovered.  Two  similar  studies  of  utilization  data  before  and  after  the 
introduction  of  cost-sharing  provisions  on  subscriber  contracts,  one  in  Saskatch- 
ewan (50),  the  other  at  Stanford  (128),  both  showed  a  large  drop  in  utilization 
after  cost-sharing  became  effective. 

While  the  studies  cited  above  all  support  the  contention  that  cost-sharing 
reduces  utihzation  of  health  services,  two  caveats  are  in  order.  First,  it  is  not 
possible  to  discern  whether  necessary  or  unnecessary  utilization  was  reduced. 
Cost-sharing  hopes  to  attack  the  latter  while  not  affecting  the  former.  To  the 
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extent  that  it  also  affects  the  former,  it  is  exercising  cost  control  inappropriately. 
Second,  there  are  a  number  of  studies  which  reach  the  conclusion  that 
cost-sharing  is  an  ineffective  cost  control  mechanism.  Comparisons  of  utilization 
data  from  two  Pennsylvania  Blue  Cross  plans  (57)  showed  no  utihzation 
differences  despite  the  fact  that  one  plan  featured  full  coverage  while  the  other 
had  a  copayment  provision.  In  Connecticut  (60),  statistically  insignificant 
increases  in  utihzation  were  found  among  groups  of  subscribers  changing  from  an 
indemnity  contract  to  a  full  service  contract.  Finally,  further  support  for  the 
contention  that  cost  sharing  is  an  ineffective  cost  control  mechanism  is  found  in  a 
study  comparing  a  plan  with  a  deductible  to  a  plan  offering  full  service  in  which 
no  utihzation  differences  occurred  (72). 

Of  course,  there  are  methodological  and  statistical  limitations  to  all  of  the 
studies  mentioned.  Nevertheless,  Ginsburg  and  Manheim  (50)  conclude  from  the 
above  that  consumer  cost  sharing  does  affect  utihzation  of  medical  care,  and  that 
the  magnitude  of  its  effect  depends  on  demographics,  price,  and  the  extent  of 
services  provided.  Hall  (56)  is  not  prepared  to  draw  the  same  conclusion,  claiming 
instead  that  while  there  is  more  evidence  that  cost-sharing  reduces  utilization  than 
that  it  has  no  effect,  the  evidence  is  still  such  that  it  leaves  the  issue  in  doubt. 

An  interesting  slant  on  the  contention  under  consideration  may  ultimately 
decide  the  issue.  Weisbrod  et.al.(165)  have  advanced  the  hypothesis  that  there  is 
no  middle  ground  in  this  area,  i.e.  that  utilization  will  be  totally  unaffected  unless 
the  price  framework  in  which  consumers  make  their  decision  to  purchase  health 
care  is  a  zero  price  framework.  Their  argument  is  essentially  that  any  cost-sharing 
provision  completely  negates  the  effect  of  moral  hazard.  The  subtlety  of  their 
argument  lies  in  the  fact  that  they  deny  the  idea  that  cost-sharing  must  be  applied 
at  a  reasonably  high  level  (deductibles  near  $50,  coinsurance  rates  of  20  percent) 
to  be  effective.  They  contend,  then,  that  small  cost-sharing  provisions  may  be  as 
effective  as  large  ones  for  purposes  of  cost  control.  The  validity  of  this  argument 
would  mean  that  the  issue  of  cost-sharing  as  a  burden  to  poor  people  and  the 
disadvantaged,  and  therefore  as  an  undesirable  feature  of  insurance  contracts, 
could  be  resolved  gracefully  by  using  small  cost-sharing  provisions  that  would 
minimize  or  essentially  eliminate  the  burden  to  the  poor  while  at  the  same  time 
result  in  stable  utilization.  Their  study  referenced  above  supports  this  hypothesis. 

B.  PHYSICIAN  REIMBURSEMENTTECHNIQUES 

1.  Usual,  Customary  and  Reasonable  Fees 

The  usual,  customary,  and  reasonable  (UCR)  fee  approach  to  physician 
reimbursement  grew  out  of  the  reasonable  charges  model  of  the  Medicare 
legislation  and  is  now  an  accepted  form  of  cost  control  by  third  parties.  Usual  in 
this  context  means  the  usual  fee  charged  by  a  physician  for  a  given  service. 
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Customary  means  the  fee  corresponds  to  fees  charged  by  similar  physicians  in  the 
same  geographical  area  for  the  same  service.  Reasonable  has  come  to  imply  a  fee 
level  calculated  from  a  distribution  of  the  fees  of  physicians  who  have  been 
grouped  as  similar.  A  maximum  reasonable  fee  is  calculated  by  applying  an 
arbitrarily  chosen  percentile  cut-off  to  the  distribution  of  fees  under  discussion.  If 
the  fee  appearing  on  a  claim  is  usual,  customary,  and  reasonable,  it  will  normally 
be  paid  without  further  delay.  If  not,  the  fee  may  be  reduced  or  negotiated. 

To  develop  UCR  guidelines,  third  parties  normally  require  physicians  to 
pre-file  their  fee  schedules,  which,  combined  with  data  on  individual  physicians 
available  from  previous  claims  over  a  period  of  time,  enable  the  insurance  carriers 
to  perform  the  appropriate  calculations.  Usual  fees  are  determined  either  by 
taking  the  fee  a  physician  charges  to  an  overwhelming  majority  of  patients  or  by 
taking  the  median  of  the  fees  a  physician  has  charged  for  a  given  service.  There  are 
a  number  of  methods  available  to  determine  customary  and  reasonable  fees  of 
similar  physicians  in  a  given  geographical  area.  One  is  to  take  all  physician  charges 
for  a  given  service,  set  up  a  profile  of  the  group,  and  apply  a  percentile  cut-off. 
While  this  method  weights  all  physicians  equally,  a  second  method  which  weights 
them  unequally  may  be  preferable.  This  method  involves  taking  all  claims  for  a 
given  service,  developing  a  profile,  and  applying  the  cut-off.  This  calculation  takes 
into  account  the  fact  that  not  all  physicians  deliver  the  same  range  of  services,  nor 
do  they  necessarily  serve  the  same  population  groups  within  the  given 
geographical  area,  a  fact  that  may  lead  some  physicians  to  render  more  of  one 
service  than  other  physicians  might.  A  third  method  is  to  find  the  customary  and 
reasonable  fee  by  both  methods  discussed  above,  and  take  the  higher,  the  lower, 
or  the  average  of  the  two.  While  third  parties  may  normally  choose  the  percentile 
cut-off  as  they  wish.  Medicare  fiscal  intermediaries  must  make  the  cut-off  at  the 
84th  percentile  (one  standard  deviation). 

The  key  to  cost  control  with  UCR  is  that  it  does  not  permit  a  physician's 
fees  to  exceed  certain  guidelines,  thus  putting  an  upper  Hmit  on  costs.  With  an 
appropriate  surveillance  apparatus,  UCR  could  theoretically  serve  as  a  reasonable 
cost  control  mechanism.  Furthermore,  even  though  physicians  are  of  course 
permitted  to  revise  their  fee  schedules  upward,  the  fee  schedule  changes  are  not 
recognized  immediately,  but  are  subject  to  3-12  month  delays.  Thus  overall  costs 
are  held  down,  and  fee  increases  may  be  discouraged. 

Unfortunately,  UCR  has  problems  in  both  methodology  and  effectiveness. 
While  a  percentile  cut-off  to  determine  a  maximum  reasonable  charge  might  be 
appropriate  in  a  narrow  range  of  fees  with  only  a  few  real  deviations  from  a 
cluster,  such  a  mechanism  of  cost  control  might  well  be  inappropriate  in  a  widely 
spread  distribution.  Furthermore,  the  percentage  cut-off  results  in  physician 
knowledge  of  what  is  and  what  is  not  an  acceptable  fee.  A  physician  can  therefore 
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determine  what  kind  of  fee  increases  will  be  tolerated,  and  may  make  his 
adjustments  accordingly.  At  a  minimum,  a  physician  can  be  expected  to  move  to 
the  average  fee  if  his  fee  is  lower  than  average.  UCR  can  thus  lead  to  a 
self-generating  increase.  Furthermore,  the  possibility  that  physicians  may  fear  a 
change  in  the  percentage  cut-off  might  tend  to  create  movement  to  higher  fees  as 
quickly  as  possible.  One  possible  modification  of  UCR  to  avoid  these  problems 
might  be  to  eliminate  pre-filing  of  fees  and  pay  the  physician  his  usual  fee  while 
using  spot  check  audits  for  surveillance  purposes. 

Another  problem  with  UCR  is  that  often  a  fee  that  falls  outside  the  UCR 
guidelines  is  nevertheless  justifiable  due  to  special  procedures  or  circumstances. 
Not  to  pay  the  fee  is  to  be  clearly  unjust  to  the  physician.  At  the  same  time,  to 
look  over  every  claim  for  special  procedures  would  involve  enormous  administra- 
tive expense.  How  to  balance  equitable  reimbursement  to  the  physician  without 
incurring  additional  administrative  expense  remains  a  problem  for  UCR. 

A  third  problem  for  this  method  of  cost  control  is  that  the  delay  in 
recognition  of  fee  increases  may  actually  be  counterproductive.  While  it  appears 
to  be  a  reasonable  way  to  keep  expenditures  down,  such  delays  (once  they  are 
recognized  by  physicians)  may  stimulate  increases  sooner  than  they  would 
normally  occur. 

A  much  more  fundamental  problem  for  UCR,  which  exists  for  other  cost 
control  mechanisms  used  under  the  fee-for-service  system  as  well,  is  the  fact  that 
while  unit  or  factor  prices  may  be  controlled,  expenditures  may  not  be  controlled 
due  to  overutilization.  While  cost  control  is  the  issue  under  discussion, 
expenditure  control  is  an  equally  important  issue.  The  health  care  crisis  is  not 
only  a  crisis  of  escalating  unit  costs;  it  is  also  a  crisis  of  escalating  total  costs. 
Expenditure  control,  since  it  focuses  on  the  problem  of  utilization,  is  an  issue  that 
is  not  addressed  by  any  of  the  reimbursement  techniques  to  be  discussed  in  this 
paper.  However,  the  sections  on  claims  review  and  group  practice  prepayment 
plans  both  recognize  expenditure  control  as  a  vital  issue. 

In  the  final  analysis,  reasonable  charges  reimbursement  via  UCR  comes  to 
mean  physician-determined  charges.  Whatever  fees  physicians  as  a  group  deter- 
mine are  reasonable  are  the  fees  paid.  While  the  physicians  are  supposed  to  be  the 
controlled,  they  are  in  point  of  fact  the  controllers,  and  it  is  the  very  process  of 
calculating  a  usual,  customary,  and  reasonable  fee  from  physician-determined  data 
that  limits  the  effectiveness  of  UCR  as  a  cost  control  mechanism. 
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2.  The  Fee  Schedule 


This  reimbursement  technique  is  the  Blue  Shield  model  of  contractual 
arrangements  with  all  physicians  coupled  with  a  uniform  fee  schedule  for  services 
and  beneficiary  income  limits.  It  has  the  provision  that  a  physician  can  charge 
more  to  certain  patients  than  to  others  (depending  on  family  income)  and  collect 
the  difference  between  Blue  Shield  reimbursement  and  his  charges  directly  from 
the  patient.  Cost  control  is  exercised  via  the  physician's  obligation  through  the 
contract  to  accept  the  Blue  Shield  fixed  fee  as  full  reimbursement  for  his  services 
if  the  patient's  income  is  within  the  prescribed  income  limits.  The  weakness  of 
this  method  of  cost  control  is  that  it  permits  a  physician  to  charge  whatever  he 
wants  to  patients  whose  income  falls  beyond  the  income  limits.  Thus  only  partial 
cost  control  is  exercised  by  the  fee  schedule  approach  as  implemented  by  Blue 
Shield. 

While  elimination  of  income  limits  would  make  the  use  of  fixed  fee  schedules 
more  effective,  their  practicahty  is  still  quite  limited.  No  quahty  considerations  are 
given  in  a  fixed  fee  schedule.  Without  a  range  of  fees  that  recognizes  quahtative 
variations  in  services,  physicians  would,  with  good  reason,  never  adhere  to  fixed  fee 
schedules.  With  a  range  of  fees,  however,  some  of  the  cost  controlling  power  of  a  fee 
schedule  is  lost,  and  the  schedule  is  certainly  no  longer  fixed. 

3.  The  Relative  Value  Schedule 

The  concept  of  a  relative  value  schedule  (RVS)  which  is  now  in  use  in  a 
number  of  localities  became  widely  known  through  its  origins  in  California.  The 
RVS  was  developed  from  data  on  fees  charged  by  Cahfornia  physicians  for  their 
medical  services.  Median  charges  for  each  procedure  are  statistically  determined, 
and  the  RVS  reflects  the  ratios  that  exist  between  these  median  values  by 
assigning  an  appropriate  unit  value  to  each  procedure.  Thus  if  the  median  charge 
for  one  service  is  $100  and  the  median  charge  for  another  is  $20,  the  RVS  will 
reflect  this  5 : 1  ratio  with  a  5 : 1  ratio  in  unit  values  assigned  to  the  two  services 
under  consideration. 

Wide  variations  from  the  state-wide  RVS  may  exist,  both  within  geographical 
subdivisions  of  the  state  and  certainly  with  individual  physicians,  in  the  relative 
values  of  the  appropriate  fee  schedule.  Keeping  this  and  the  fact  that  the  RVS 
reflects  ratios  of  median  values  in  mind,  an  RVS  can  nevertheless  be  useful  in 
three  ways:  1)  to  physicians,  to  assist  in  fee-setting;  2)  to  insurance  carriers  and 
governmental  programs,  either  as  guidelines  for  reimbursement  or  as  a  formal 
policy  requiring  the  compHance  of  all  participating  physicians;  3)  and  to  both,  to 
provide  a  coding  system  for  services  that  is  universal  and  which  facilitates  claims 
processing  if  used  by  both  physician  and  third  party. 
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The  California  RVS  is  divided  into  five  sections:  medicine,  anaesthesia, 
surgery,  radiology /nuclear  medicine,  and  pathology.  Such  a  division  of  services  is 
appropriate  not  only  to  retain  simpHcity  in  unit  values  assigned  to  each  service, 
but  also  to  reflect  the  differences  in  overhead  costs  for  each  division.  The  RVS  is 
in  no  way  comparable  to  a  fixed  fee  schedule;  it  is  a  sophisticated  instrument 
which  makes  provision  for  special  services  and  modifications  that  allow  a 
physician  to  alter  his  fee  if  the  service  rendered  does  not  precisely  fit  the 
prototype  description  in  the  RVS.  Examples  of  this  flexibility  are  modifiers  that 
permit  increases  in  fees  to  reflect  special  supplies,  night  visits,  etc.,  and  other 
modifiers  that  indicate  a  reduction  of  fee  for  multiple  surgical  procedures  and 
incidental  procedures. 

As  mentioned  above,  the  RVS  in  no  way  provides  estimates  of  fees  in  an 
absolute  sense;  physicians  who  use  the  RVS  to  determine  fees  are  encouraged  to 
do  so  by  estimating  the  value  of  their  services,  the  time  and  materials  spent  in 
supplying  such  services,  and  the  economics  of  their  own  practice.  A  simple 
procedure  for  calculating  the  money  value  of  an  RVS  unit  of  service  for  each 
section  of  the  RVS  is  to  use  the  physician's  own  fee  schedule.  To  arrive  at  a  fee 
schedule  based  on  RVS,  then,  is  only  a  matter  of  multiplying  the  money  value  of 
one  RVS  unit  by  the  number  of  units  assigned  to  each  service. 

Use  of  the  RVS  as  a  surveillance  technique  allows  monitoring  of  the 
consistency  of  fees  in  a  relative  sense.  However,  if  used  as  a  policy  instrument  by 
insurance  carriers  to  control  the  reimbursement  to  individual  physicians, 
application  of  RVS  to  effective  cost  control  is  hampered  by  a  variety  of  factors. 
The  real  issue  of  cost  control  revolves  around  absolute  costs.  If,  for  example,  the 
insurance  carrier  only  reimburses  the  physician  up  to  the  RVS-determined  value 
of  his  services  as  calculated  from  his  own  fee  schedule  which  is  available  in  the 
carrier's  data  base,  and  the  physician  can  collect  any  excess  from  the  patient,  then 
there  is  no  cost  control.  Furthermore,  even  if  the  physician  agrees  to  charge  only 
the  RVS-determined  fee  for  his  services  (by  contractual  agreement  with  the 
insurance  carrier),  the  fee  itself  is  dependent  on  the  absolute  level  of  his  fee 
schedule,  which  in  turn  depends  on  an  individual's  skill,  education,  age,  status, 
malpractice  insurance  costs,  etc,  which  can  vary  widely  among  physicians.  Since 
the  absolute  level  of  fee  schedules  is  the  dominant  force  in  cost  control  here, 
application  of  the  RVS  norms  to  the  relative  values  of  a  physician's  fees  may  be, 
at  best,  a  marginal  action.  More  importantly,  for  every  physician  who  discovers 
that  the  insurance  carrier  will  not  reimburse  his  full  fee  because  his  relative  values 
are  out  of  line  on  the  high  side,  it  is  just  as  likely  that  another  physician  will 
discover  his  fees  are  out  of  Hne  on  the  low  side  and  adjust  accordingly.  In 
emphasizing  consistency  of  fees,  an  RVS  may  actually  be  of  little  aid  in 
controlling  costs  unless  accompanied  by  absolute  fee  norms  and  a  workable 
surveillance  mechanism. 
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C.  HOSPITAL  REIMBURSEMENT  TECHNIQUES 


1.  The  Medicare  Model 

Medicare  legislation  provides  that  hospitals  participating  in  the  Medicare 
program  should  be  reimbursed  on  the  basis  of  reasonable  costs.  This  is  due  to  the 
prevailing  philosophy  in  the  legislation  that  the  Medicare  program  ought  to  pay 
the  actual  cost  of  providing  care  to  its  beneficiaries  and  not  subsidize  any  other 
hospital  users  (159).  In  addition  to  the  cost  of  actual  services  and  suppHes, 
legitimate  hospital  costs  that  are  fully  reimbursable  include  contributions  toward 
increases  in  v^orking  capital,  mortgage  amortization  payments,  capital  improve- 
ment and  expansion,  depreciation,  and  imputed  interest  on  net  capital  invest- 
ment. 

The  Medicare  program  reimburses  hospitals  on  an  interim  basis,  with  a  final 
accounting  and  adjustment  at  the  end  of  the  hospital's  fiscal  year.  While  interim 
reimbursement  is  important  to  the  cash  flow  of  the  hospital,  the  issue  of  cost 
control  is  only  addressed  via  final  accounting  and  adjustment.  All  hospitals  are 
expected  ultimately  to  use  the  departmental  ratio  of  Medicare  charges  to  total 
charges  apphed  to  total  costs  (RCCAC)  for  this  purpose.  With  this  method,  the 
ratio  of  charges  to  Medicare  patients  to  charges  to  all  patients  is  calculated  for 
each  department.  The  total  costs  of  each  department  are  then  multiplied  by  the 
ratio  to  determine  that  portion  of  costs  that  should  be  allocated  to  Medicare  and 
therefore  reimbursed  by  Medicare.  Note  that  this  calculation  depends  on  the 
charge  structure  of  the  hospital.  If  charges  are  related  to  costs,  then  Medicare  will 
probably  pay  about  what  the  legislation  says  it  ought  to  pay.  On  the  other  hand, 
if  charges  are  not  related  to  costs,  as  is  often  the  case  in  hospitals  today,  then 
Medicare  might  pay  more  than  its  responsible  share.  This  is  a  critical  weakness  of 
RCCAC  as  a  cost  control  mechanism.  With  non-cost-related  charges,  the  ratio  of 
Medicare  charges  to  total  charges  can  be  manipulated  in  favor  of  the  hospital 
either  by  increasing  Medicare  charges  or  decreasing  other  patient  charges,  since 
reimbursement  does  not  relate  to  charges,  but  to  costs.  Partial  control  of  the 
amount  reimbursed  is  thus  put  in  the  hands  of  the  hospital,  with  no  control  over 
its  manipulation  of  charges  (70). 

A  more  fundamental  question  ought  to  be  asked  at  this  point  as  to  whether 
cost-based  reimbursement  is  even  a  conceptually  viable  cost  control  mechanism. 
Cost  reimbursement  is  criticized  as  promoting  inefficiency,  or  at  least  providing 
no  incentives  to  economize.  Realistically,  what  cost-based  reimbursement  does  is 
to  guarantee  reimbursement  for  costs  that  are  not  determined  in  a  competitive 
market,  not  regulated  by  pubhc  authority,  and  not  subject  to  significant  internal 
control.  There  seems  to  be  very  little  doubt  that  cost  control  is  not  being  effected 
under  these  circumstances. 
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2.  The  Western  Pennsylvania  Model 

A  more  sensible  approach  to  cost-based  reimbursement  is  to  couple  it  with  a 
maximum  payment  schedule.  Such  a  program  is  in  use  by  Blue  Cross  of  Western 
Pennsylvania  (93).  Hospitals  are  grouped  by  metropolitan/urban/nonurban 
divisions,  then  by  advanced  teaching/teaching/non-teaching  divisions  to  form  nine 
hospital  categories.  The  average  costs  of  each  group's  services  are  calculated,  and 
reimbursement  to  a  hospital  is  limited  to  1 10  percent  of  the  group's  average  costs. 
Semi-annual  audits  are  conducted,  and  hospitals  can  appeal  the  ceiling  limitation 
when  it  is  perceived  to  be  unjust.  While  reimbursement  still  relates  to  costs,  there 
are  at  least  incentives  in  this  model  for  high  cost  hospitals  to  reduce  their  costs  or 
face  less  than  full  cost  reimbursement. 

3.  The  Blue  Cross  Model 

The  large  majority  of  Blue  Cross  plans  provide  cost-based  reimbursement  to 
hospitals  through  contractual  arrangements.  A  schedule  of  per  diem  payments 
based  on  the  hospital's  charges  is  developed  by  Blue  Cross  and  the  hospital;  the 
normal  Blue  Cross  payment  ranges  from  80  percent  to  100  percent  of  charges. 
While  the  previously-mentioned  inefficiencies  of  cost-based  reimbursement  apply 
to  this  model,  they  are  tempered  somewhat  by  Blue  Cross  efforts  to  police 
hospital  costs.  Cost  control  in  this  model  stands  or  falls,  then,  on  the  nature  of 
the  policing  effort. 

4.  The  Inclusive  Rate 

One  important  element  of  hospital  costs  is  the  preparation  of  claims  for 
submission  to  insurance  carriers.  Many  hospitals  use  an  average  billing  rate  for 
some  services,  but  itemize  the  large  majority  of  ancillary  services.  A  recent  HEW 
study  indicates  that  while  very  few  hospitals  currently  utilize  an  inclusive  rate 
system,  cost  control  can  be  exercised  by  its  use  (1 58). 

An  inclusive  billing  rate  attempts  to  approximate  expected  usage  of  services 
by  the  hospital's  patients  as  closely  as  possible  without  resorting  to  itemization. 
In  no  sense,  however,  should  an  inclusive  rate  be  thought  of  as  a  synonym  for  a 
hospital-wide  average  cost  per  patient  day.  Rather,  hospitals  using  such  a  system 
categorize  their  patients  according  to  patient  characteristics,  type  of  care 
characteristics,  accommodations,  etc.,  so  that  a  rate  with  the  name  "third  day, 
over  65,  surgical,  intensive  care"  quaUfies  as  an  inclusive  rate  as  long  as  it  is 
applied  to  the  third  day  of  stay  of  all  patients  over  65  who  are  hospitalized  for 
surgery  in  the  intensive  care  unit.  Generally,  an  inclusive  rate  ought  to  take  into 
consideration  such  indices  of  patient  differentiation  as  diagnosis,  category  of  care, 
day  of  stay,  type  of  accommodation,  age,  and  excluded  items. 
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Results  of  the  HEW  study  show  that  for  both  inpatient  and  outpatient  care, 
significant  savings  can  be  achieved  in  accounting  system  operating  costs  with  the 
adoption  of  inclusive  rates.  For  inpatients,  for  whom  an  average  of  14  ancillary 
services  are  currently  processed  per  patient  day,  an  estimated  saving  of  37  percent 
of  accounting  costs  would  be  achieved  with  this  system,  due  to  smaller  staff 
requirements  in  the  business  office,  less  use  of  data  processing  equipment,  and  a 
reduction  in  accounts  receivable  due  to  enhanced  ability  to  present  a  bill  to  the 
payer,  whether  third  party  or  the  patient,  on  the  day  of  discharge  rather  than 
after  waiting  for  all  late  charges  to  filter  through  the  accounting  system.  While 
estimates  of  savings  in  outpatient  accounting  costs  are  also  significant  (20 
percent),  the  applicability  of  inclusive  rates  to  outpatient  departments  is  limited 
due  to  the  much  wider  variation  in  outpatient  charges  among  hospitals  and  the 
relatively  small  size  of  the  total  bill.  For  these  reasons,  averaging,  even  across 
limited  categories,  may  not  be  able  to  gain  wide  acceptance  for  outpatient 
services,  and  uniform  charges,  if  high,  might  easily  discourage  patients  against 
receiving  care. 

Besides  demonstrable  cost  savings,  there  are  two  other  arguments  in  favor  of 
inclusive  billing  rates.  One  is  that  patient  anxiety  will  be  decreased  since  the  total 
bill  can  be  predicted  within  reasonable  boundaries  if  the  length  of  stay  can  be 
estimated.  While  legitimate,  this  argument  is  neutral  with  regard  to  cost  control. 
The  other  is  that  physicians  can  practice  without  thinking  about  the  patient's 
financial  resources.  This  argument  does  not  speak  well  for  the  proponents  of 
inclusive  rates.  On  the  one  hand,  there  is  an  implication  that  physicians  may 
currently  compromise  quahty  of  care  for  the  patient's  financial  sake,  and  thus 
underutiUze  services.  On  the  other,  if  the  first  implication  is  not  true,  then  the 
argument  suggests  utilization  may  increase.  The  latter  seems  more  valid;  if  so,  it  is 
an  argument  in  opposition  to  inclusive  rates  rather  than  in  favor  of  them. 

There  are  other,  more  telling  arguments  in  opposition  to  inclusive  rates,  the 
most  important  of  which  revolves  around  the  question  of  utilization  review. 
Inclusive  rates  are,  for  all  practical  purposes,  in  opposition  to  the  overwhelming 
trend  toward  utihzation  review  and  control.  By  doing  away  with  itemization  of 
ancillary  charges,  inclusive  rates  make  it  much  more  difficult  to  monitor  typical 
utilization  review  parameters.  In  all  likelihood,  inclusive  rates  will  not  properly 
reflect  patterns  of  ancillary  services  utihzation  for  a  third  party's  subscriber 
population.  Since  effective  cost  control  is  linked  to  utilization,  and  because  all 
current  systems  c^re  geared  to  itemization  for  audit  and  utilization  review 
purposes,  it  is  difficult  to  rationalize  movement  away  from  a  cost  control  system 
that  has  just  recently  come  into  existence  and  which  has  begun  to  show  its 
effectiveness. 
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The  tendency  for  costs  to  rise  due  to  reduced  audit  ability  is  another 
argument  against  inclusive  rates.  In  addition,  inclusive  rates  do  not  conform  to  the 
philosophy  of  equity  as  stated  in  the  Medicare  legislation,  and  would  have 
acceptance  problems  for  that  reason.  Finally,  cutting  patient  differentiation 
categories  too  finely  might  result  in  the  need  for  an  accounting  system  which 
would  reduce  or  eliminate  all  cost-savings  attributable  to  reduced  ancillary 
accounting  needs  under  the  itemization  system.  While  the  desire  to  eliminate 
itemization  of  frequently  received  ancillary  services  via  inclusive  billing  rates  is 
logical  and  cost-conscious,  its  neglect  of  the  larger  cost  control  question, 
utilization,  will  probably  mean  that  use  of  inclusive  rates  will  not  expand  from 
the  less  than  1  percent  of  all  non-government  hospitals  that  currently  use  them. 

D.  INCENTIVE  REIMBURSEMENT  MODELS 

The  critical  problem  with  cost-based  reimbursement  for  hospitals,  as 
discussed  in  preceding  sections,  is  the  lack  of  incentive  for  efficiency,  economy, 
and  cost  control.  In  an  effort  to  alleviate  this  problem,  a  number  of 
reimbursement  mechanisms  with  incentives  for  cost  control  have  been  imple- 
mented and  are  designed  to  reward  the  efficient  while  penalizing  the  inefficient. 

1.  The  Philadelphia  Blue  Cross  Model 

One  of  the  earliest  experiments  in  incentive  reimbursement,  which  took 
place  in  the  early  1950's,  varied  reimbursement  rates  according  to  length  of  stay. 
Blue  Cross  paid  hospitals  more  than  their  average  costs  for  the  first  two  days  of 
stay,  followed  by  progressively  lower  rates  as  the  duration  of  stay  lengthened.  The 
incentive  to  hospitals  was  a  financial  gain  if  a  patient  were  to  be  discharged  early. 
Combined  with  an  appropriate  monitoring  mechanism  to  guard  against  underutili- 
zation,  this  model,  though  subsequently  abandoned  by  Philadelphia  Blue  Cross, 
could  be  used  after  appropriate  modification. 

2.  The  Northeast  Ohio  Blue  Cross  Model 

Also  instituted  in  the  1950's,  this  model  provided  cash  awards  to  hospitals 
keeping  cost  increases  below  the  average  for  a  given  geographical  area.  If  a 
hospital  were  able  to  achieve  cost  increases  below  average,  it  was  given  20  percent 
of  the  difference  between  its  costs  and  average  costs  to  be  used  for  capital 
improvement,  teaching,  or  research.  With  appropriately  grouped  hospitals,  this 
model  might  prove  workable.  Geographic  grouping,  however,  fails  to  take  account 
of  hospital  characteristics  which  defeats  the  purpose  of  the  concept. 
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3.  The  Target  Rate  Model 


This  is  one  of  a  number  of  HEW-authorized  experiments  in  incentive 
reimbursement  that  commenced  during  1968-1969  (157).  Involving  the  Greater 
New  York  Hospital  Association,  Blue  Cross  of  New  York,  and  Medicare,  this 
model  set  target  rates  for  total  hospital  inpatient  costs  with  minimum  and 
maximum  payments  on  both  sides  of  the  target  rate.  In  no  case  would  a  hospital 
receive  less  than  the  minimum,  nor  more  than  the  maximum,  for  reimbursement. 
Thus  if  a  hospital's  costs  came  in  under  the  minimum,  the  hospital  would  receive 
a  financial  reward;  if  between  the  minimum  and  maximum,  no  reward;  and  if  over 
the  maximum,  a  penalty  in  the  form  of  partial  reimbursement. 

A  variation  of  the  target  rate  model  was  instituted  by  the  Medicare  program 
in  conjunction  with  the  Connecticut  Hospital  Association.  Targets  were  set  on  a 
departmental  rather  than  a  hospital-wide  basis.  If  costs  were  lower  than  the  target 
set,  the  hospital  would  receive  the  target  rate  or  a  payment  calculated  from  the 
Medicare  reimbursement  formula,  whichever  was  higher.  If  the  hospital  were  on 
target,  it  would  receive  the  reimbursement  formula  payment,  while  if  its  costs 
were  higher  than  target,  it  would  receive  98  percent  of  the  reimbursement 
formula  payment  as  a  penalty. 

The  crucial  problem  with  target  rates  is  that  hospitals  could  lower  their  costs 
by  keeping  patients  an  extra  day  while  rendering  no  medical  services.  Targets 
would  be  reached  at  the  cost  of  increasing  expenditures.  It  would  appear  that  to 
make  target  rates  effective  requires  the  simultaneous  use  of  outside  utilization 
review  to  prevent  such  manipulation. 

4.  The  Individual  Hospital  Negotiation  Model 

As  another  HEW  experimental  model,  this  program  was  developed  in 
collaboration  with  the  Hospital  Cost  Analysis  Service  (HCAS)  of  Maryland.  It 
features  a  revamped  cost  reimbursement  formula  with  outside  review  and  upper 
limits  on  reimbursement.  Departmental  costs  are  reviewed  by  HCAS,  taking  into 
account  trends,  the  hospital's  previous  cost  experience,  and  comparative  costs  in 
other  hospitals,  and  an  upper  limit  on  reimbursement  is  set.  If,  during  the  course 
of  review,  difficulties  are  uncovered,  then  a  joint  HCAS-hospital  conference  is 
held  to  pinpoint  the  problem  with  special  emphasis  on  providing  assistance  in 
revamping  accounting  and  management  control  practices.  Rewards  and  penalties 
similar  to  those  used  in  the  target  rate  model  are  also  used.  While  administratively 
cumbersome  and  expensive  to  analyze  each  individual  hospital,  the  value  of  the 
system  lies  in  its  theoretical  ability  to  prospectively  influence  or  stabilize  costs. 
No  retroactive  adjustments  are  permitted  as  in  the  basic  Medicare  RCCAC 
reimbursement  model. 
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5.  The  Georgia  Medical  Care  Foundation  Model 

This  program  affects  Medicaid  payments  to  hospitals  for  inpatient  care  in 
Georgia  (33).  Payments  are  made  according  to  the  following  method:  expected 
average  lengths  of  stay  are  determined  from  Southern  Region  PAS  data  by  five 
age  groups  (0-19,  20-34,  35-49,  50-64,  65+)  according  to  diagnostic  and  surgical 
categories.  A  lump  sum  payment  is  then  made  to  hospitals  by  multiplying  the 
expected  average  length  of  stay  for  the  patient  by  the  daily  reimbursement  rate 
established  for  the  hospital  by  the  Medicaid  program.  Thus  the  hospital  receives  a 
fixed  payment  for  each  patient  no  matter  how  long  or  short  his  actual  length  of 
stay  may  be.  The  incentive  to  keep  length  of  stays  down  via  effective  utilization 
review  is  clear.  Successful  utilization  review  means  financial  rewards;  unsuccessful 
review  means  no  reimbursement.  What  happens  to  quality  of  care  remains  an  issue 
here.  If  patients  are  discharged  before  they  are  medically  ready,  or  if  important 
pre-  or  post-operative  procedures  are  deleted  from  patient  protocols  in  order  to 
shorten  length  of  stay,  then  this  incentive  reimbursement  model  is  an  inappropri- 
ate one.  To  be  acceptable,  it  must  operate  with  a  utilization  review  committee  in 
which  underutilization  receives  as  much  attention  as  overutilization. 

E.  PROSPECTIVE  BUDGET  REVIEW 

The  concept  of  prospective  review  of  costs  is  also  found  in  the  idea  of  prior 
budget  review.  Payments  are  based  on  projected  budgets  negotiated  in  a  joint 
review  session  prior  to  the  commencement  of  the  fiscal  year.  Desirable  features  of 
this  model  are  that  hospitals  must  project  expenses  and  the  expected  volume  of 
services,  in  itself  a  stimulus  to  administrative  thinking,  and  that  review  of  budgets 
can  be  made  before  costs  are  incurred,  a  refreshing  change  from  retrospective 
review  of  a  hospital's  costs.  This  model  can  serve  to  eliminate  the  problem  of 
retroactive  rejection  of  claims  that  has  plagued  the  health  care  financing  system  in 
recent  years,  as  well  as  to  warn  hospitals  in  advance  that  certain  projected  costs 
will  not  be  reimbursable  if  incurred.  To  insure  fairness  to  all  concerned  parties, 
hospitals,  insurance  carriers,  and  the  community,  such  a  program  ought  to  be 
carried  out  by  a  state  regulatory  or  planning  agency.  This  stipulation  is  made  to 
insure  that  no  third  party  dominates  the  health  insurance  market  completely.  The 
most  significant  drawback  to  prior  budget  review  is  that  if  this  year's  budget  is 
based  on  last  year's  cost  experiences,  then  the  system  is  really  one  of  cost-based 
reimbursement.  This  is  not  entirely  satisfactory  as  a  cost  control  technique,  for 
reasons  previously  mentioned. 
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1.  The  Rhode  Island  Model 


A  combination  of  prospective  reimbursement,  financial  incentives,  and 
negotiated  budgets  make  this  model  of  cost  control  with  incentive  reimbursement 
quite  intriguing  (15).  Each  Rhode  Island  hospital  must  first  submit  its  budget  for 
the  coming  fiscal  year  to  the  Rhode  Island  Hospital  Association  for  review  by  a 
committee  of  representatives  from  each  hospital.  After  reworking,  the  budgets  are 
then  sent  to  Rhode  Island  Blue  Cross  for  review  and  negotiation  before  the  fiscal 
year  begins  (the  exceptionally  large  share  of  the  health  insurance  market  held  by 
Rhode  Island  Blue  Cross  accounts  for  its  critical  role  in  the  budgeting  process). 
Prospective  rates  of  payment  are  derived  from  the  final  approved  budget,  which 
cannot  be  changed  except  if  hospital  utilization  falls  outside  the  range  of 
utilization  parameters  written  into  the  contract.  At  the  end  of  the  year,  a  final 
accounting  of  costs  is  made,  with  any  excess  of  reimbursement  over  costs  shared 
by  Blue  Cross  and  the  hospital.  If  costs  exceed  reimbursement,  the  hospital  must 
absorb  the  loss  as  a  penalty. 

Some  details  of  the  plan  deserve  mention.  Budget  calculations  are  broken 
down  into  actual  operating  expenses  the  previous  year,  projected  operating 
expenses,  capital  budget,  and  projected  operating  statistics.  When  budget 
negotiations  are  completed,  Blue  Cross  calculates  prospective  reimbursement  rates 
in  four  categories:  routine  inpatient  services,  nursery  and  delivery  room  services, 
outpatient  emergency  treatment,  and  ancillary  services  (inpatient  and  outpatient). 
Utilization  parameter  boundaries  within  which  utilization  may  fluctuate  without 
changes  in  the  reimbursement  rates  are:  total  patient  days,  ±2  percent;  ancillary 
services  revenue  ±10  percent;  deliveries,  ±5  percent;  outpatient  visits  ±5  percent; 
and  home  care  visits,  ±5  percent.  Finally,  monthly  and  quarterly  monitoring  of 
progress  is  done  to  identify  problems  while  they  can  still  be  adequately  handled. 

The  key  to  the  success  of  this  model  is  cooperation  and  a  strong  sense  of 
commitment  by  all  Rhode  Island  hospitals  to  make  significant  inroads  with  health 
care  cost  containment  in  Rhode  Island.  The  hospitals  have  overcome  their 
reluctance  to  share  cost  figures  and  budgets,  and  now  do  so  willingly,  recognizing 
the  need  to  avoid  individuaUstic  thinking  in  a  system  setting. 

2.  The  Western  Pennsylvania  Point  System  Model 

The  heart  of  this  model  is  the  prediction  and  evaluation  of  hospital  costs 
using  the  technique  of  multiple  regression  combined  with  a  point  system  for 
weighting  purposes.  In  conjunction  with  prospective  reimbursement  or  target 
rates,  such  a  model  can  be  an  effective  cost  control  mechanism  (136). 
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The  idea  of  a  weighting  system  in  hospital  reimbursement  is  not  new.  In  the 
1940's,  the  Agnew  point  system  used  a  panel  of  judges  to  allot  points  up  to  a 
stated  maximum  to  each  hospital  for  each  facility  and  service,  based  on  the 
criteria  of  adequacy,  procedures,  and  personnel.  The  total  points  were  then 
multiphed  by  some  predetermined  rate  to  find  a  per  diem  reimbursement  rate. 
The  advantages  of  the  system  were  many.  Hospitals  were  reimbursed  according  to 
their  ability  to  provide  comprehensive  care.  Quality  facilities  and  personnel  were 
rewarded  by  higher  point  totals.  The  size  of  the  hospital  was  not  the  key  factor  in 
determining  the  amount  reimbursed.  Old  or  unnecessary  faciUties  were  often 
eliminated.  Despite  all  of  these  assets,  however,  the  system  eventually  failed 
because  points  weren't  cost-related. 

The  concept  of  the  Western  Pennsylvania  model  is  to  find  those  variables 
that  account  for  large  differences  in  costs  among  hospitals,  develop  weights  for 
each  variable,  and  use  the  weighted  variables  in  a  multiple  regression  for  cost 
estimation  and  prediction.  The  actual  model  tries  to  avoid,  insofar  as  possible, 
factors  that  can  be  manipulated  by  hospitals  to  affect  reimbursement,  and  uses 
the  following  seven  variables:  location,  size  class,  services,  education,  case  mix, 
medical  staff,  and  outpatient  activity. 

Location  was  divided  into  four  classifications;  metropolitan,  urban,  non- 
urban,  and  Pittsburgh.  Average  daily  census  was  used  to  determine  size  class, 
although  other  possibilities  would  include  number  of  beds  or  average  daily 
admissions.  Services  included  20  extraordinary  inpatient  services  hypothesized  to 
have  a  significant  effect  on  the  cost  structure  of  hospitals.  Ideally,  an  index  of  the 
number  of  services,  the  frequency  of  their  occurrence,  and  their  quality  and 
technical  level  ought  to  be  developed.  Education  was  included  by  the  use  of  an 
index  representing  the  number  of  interns  and  residents  and  the  types  of  schooling 
and  training  programs  available  in  the  hospital.  Case  mix  was  measured  as  a 
function  of  the  talents  of  the  medical  staff  on  the  assumption  that  the  abilities  of 
the  medical  staff  affect  what  kind  of  patients  will  be  seen  at  the  hospital.  An 
index  determined  by  the  numbers  of  Board-certified,  Board-eligible,  and  other 
staff  physicians  represents  medical  staff.  Outpatient  services  were  included  by  the 
ratio  of  outpatient  charges  to  total  charges,  giving  a  reasonable  approximation  of 
the  effect  of  the  outpatient  department  on  costs.  Weights  for  the  variables  were 
developed  by  a  complex  system  described  in  the  article  referenced  above. 

The  seven  variables  were  used  as  independent  variables  in  three  regression 
models,  one  linear  and  two  non-linear,  with  total  audited  cost  as  the  dependent 
variable.  Based  on  the  predictive  ability  of  the  three  models  for  1970  cost 
experiences  of  Western  Pennsylvania  hospitals,  one  of  the  non-hnear  forms  was 
chosen  as  optimal. 
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The  two  principal  applications  of  this  model  are  for  control  and  evaluation, 
and  incentive  reimbursement.  For  evaluation  purposes,  percentage  limits  of 
deviation  on  both  sides  of  predicted  costs  can  be  set,  with  investigation  of  those 
hospitals  which  exceed  the  limits  for  purposes  of  improving  operations  and 
reducing  costs,  and  investigations  of  those  falling  below  to  develop  models  of 
exemplary  cost  control  practices. 

A.  model  of  incentive  reimbursement  using  the  predictive  regression  can  be 
easily  developed.  Third  parties  could  use  the  predictive  model  to  forecast  a 
hospital's  costs  for  the  coming  fiscal  year.  The  hospital  could  either  accept  the 
forecast  or  ask  for  a  budget  review  session.  After  this  process,  prospective 
reimbursement  rates  would  be  set,  with  percentage  bands  around  the  prediction 
to  provide  incentives,  penalties,  and  maximum  reimbursement  levels.  For 
example,  hospitals  might  be  fully  reimbursed  if  costs  fell  between  97.5-102.5 
percent  of  the  predicted  costs,  share  in  all  savings  below  the  97.5  percent  level,  be 
partially  reimbursed  from  the  102.5-110.0  percent  range,  and  absorb  all  costs 
exceeding  1 10.0  percent  of  predicted  costs. 

Advantages  of  this  system  are  that  each  hospital's  predicted  costs  are  based 
on  its  individual  attributes;  hospitals  are  not  classified  into  broad-based  categories; 
it  is  difficult  for  hospitals  to  manipulate  the  variables  to  increase  their 
reimbursement;  and  an  expected  level  of  costs  is  established  as  a  target.  The 
principal  disadvantage  is  that  the  explanatory  variables  in  the  model  are  not  as 
precise  as  would  be  desirable.  Nevertheless,  initial  experience  has  indicated  the 
model's  ability  to  produce  very  accurate  predictions. 

F.  CLAIMS  REVIEW 

Before  proceeding  to  a  discussion  of  the  many  claims  review  models  included 
in  this  paper,  some  introductory  comments  are  appropriate.  Claims  review  is 
becoming  an  increasingly  more  important  method  of  cost  control  in  the  health 
care  field  as  its  ties  to  the  concepts  of  utilization  review  and  peer  review  become 
stronger.  Basically,  claims  review  systems  hope  to  compare  claims  data  against 
established  norms  of  medically  necessary  and  reasonable  treatment  protocols, 
take  into  account  reasonable  variations  that  may  be  caused  by  differences  among 
physicians  with  respect  to  their  medical  practices  and  judgment,  and  in  so  doing 
single  out  those  claims  which  represent  departures  from  expected  norms  for  closer 
inspection  and  icview  to  determine  whether  services  rendered  or  fees  charged 
were  in  fact  necessary  and  appropriate. 

The  initial  stage  of  the  claims  review  process  is  normally  geared  to  verifying 
that  the  claim  is  for  services  covered  under  the  insurance  plan.  Questions  that  are 
often  asked  at  this  stage  include:  Is  there  incompleteness,  inconsistency,  or 
duplication  of  entries  (cf.  surgery  but  no  operating  room  or  anaesthesia  charges,  or 
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vice  versa)?  Are  procedures  performed  and  the  pattern  of  care  consistent  with  the 
diagnosis?  Do  charges  appear  excessive?  Is  the  claim  covered  by  workmen's  com- 
pensation? Are  the  diagnosis  and  procedures  performed  consistent  with  those 
of  non-covered  services?  Is  the  case  a  custodial  care  case?  The  issue  of  custodial 
care  is  a  particularly  difficult  one,  and  deserves  closer  attention.  In  order  to  make  a 
judgment  on  a  potential  custodial  care  case,  claims  review  plans  often  call  for  a 
close  study  of  the  patient's  medical  record,  including  current  length  of  stay,  need 
for  skilled  services  or  constant  attention,  inpatient  history  (repeat  admissions, 
previous  long  episodes  of  illness),  utilization  review  committee  decisions, 
physician's  orders,  nursing  care  plans,  progress  notes,  and  physician  recertification 
statements.  In  short,  claims  review,  to  be  effective,  must  be  prepared  to  study  a 
case  in  minute  detail. 

It  is  common  for  claims  review  plans  to  develop  aggregate  utilization  norms 
and  identify  normal  patterns  of  care  from  analysis  of  claims  data  on  a  regular, 
frequent  basis.  Continual  updating  of  norms  is  essential,  even  if  expensive,  in 
order  to  keep  up  with  changing  methods  and  patterns  of  care.  Individual 
physicians  can  then  be  compared  to  the  aggregate  norms  and  singled  out,  where 
appropriate,  for  closer  observation  or  peer  review.  Kinds  of  norms  typically  found 
in  claims  review  procedures  are : 

•  Ratio  of  total  services  rendered  to  total  beneficiaries 

•  Ratios  of  lab  services,  x-rays,  physical  therapy,  and  injections  to  total 
beneficiaries 

•  Ratios  of  office,  home,  hospital,  nursing  home,  and  ECF  services  to 
total  beneficiaries 

•  Average  total  payments  on  assignment  to  physicians 

•  Average  total  payments  to  each  physician 

•  Number  of  multiple  visits  or  consultations  for  various  diagnoses 

•  Normal  spread  of  physician  visits  over  time 

Claims  review  plans  also  develop  physician  profiles.  A  typical  physician 
profile  includes: 

•  Total  beneficiaries  served  in  current  quarter;  year  to  date 

•  Number  of  services  provided  in  current  quarter;  year  to  date 
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•  Number  of  services  provided  by  location  (office,  home,  hospital,  etc.) 

•  Number  of  services  provided  by  type  (visits,  injections,  lab,  etc.) 

•  Charges  per  quarter;  year  to  date 

•  Allowed  charges  per  quarter;  year  to  date 

•  Total  payments  on  assignment 

•  Total  payments  to  all  beneficiaries 

•  Total  allowed  charges  per  service  per  location 

•  Total  payments  on  assignment  per  service  per  location 

•  Total  payments  to  beneficiaries  per  service  per  location 

•  Physician  demographic  statistics 

When  a  physician  is  singled  out  for  closer  surveillance  due  to  significant 
deviations  from  group  norms,  often  a  different  type  of  profile  is  generated.  Such  a 
profile  usually  includes: 

•  Number  of  services  to  each  beneficiary  by  type  of  service;  current 
quarter  and  year  to  date 

•  Number  of  services  to  each  beneficiary  by  location  of  service;  current 
quarter  and  year  to  date 

•  Charges  for  each  service 

•  Allowed  charge  for  each  service 

•  Total  charges,  all  services,  for  each  beneficiary 

•  Total  allowed  charges,  all  services,  for  each  beneficiary 

•  Total  payments  for  each  beneficiary  on  assignment 

While  the  above  examples  of  profiles  and  utilization  parameters  have  been 
given  in  terms  of  physicians,  appropriate  modifications  render  the  concepts 
equally  applicable  to  hospitals  and  patients. 
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The  remainder  of  this  section  will  be  devoted  to  a  discussion  of  various 
claims  review  models  either  in  current  use  or  in  the  developmental  stage,  followed 
by  a  brief  summary  of  the  major  attributes  of  the  claims  review  models  discussed. 

1.  The  Basic  Blue  Cross  Model 

In  a  typical  Blue  Cross  claims  review  system,  claims  are  reviewed  with 
respect  to  appropriateness  of  admission,  length  of  stay,  and  services  rendered.  In 
some  instances,  efficiency  of  hospital  scheduling  is  also  considered  (11).  While 
some  plans  review  admissions  material  from  the  hospital  and  make  a  provisional 
determination  of  eligibiHty  before  the  patient's  discharge,  frequently  the  first  step 
is  submission  of  a  completed  hospital  claims  form.  Whatever  the  case,  completed 
claims  are  reviewed  against  utilization  and  fee  norms  and  those  falling  outside  the 
guidelines  are  sent  to  the  next  stage  of  review  by  either  a  trained  clerk,  nurse,  or 
physician.  Most  Blue  Cross  plans  use  nurses  at  this  stage  of  review;  some  use  them 
exclusively.  Actions  that  may  be  taken  by  the  reviewer  at  this  time  include  a 
request  for  more  information  from  the  hospital,  personal  on-site  examination  of 
the  patient's  medical  record  at  the  hospital,  review  of  a  copy  of  the  medical 
record  at  the  Blue  Cross  office,  use  of  a  physician  questionnaire,  and  direct 
communication  with  the  physician  involved.  If  the  reviewer  cannot  reach  a 
decision  after  taking  one  of  these  five  actions,  the  claim  is  sent  to  the  Plan's 
medical  directors  or  consultants,  who  may  in  turn  refer  the  claim  for  committee 
review.  Common  committees  used  at  this  point  in  the  process  include  the  Blue 
Cross  Board  of  Trustees,  a  county  or  state  medical  society  committee,  the 
hospital's  utilization  review  committee,  a  Blue  Cross  utilization  review  committee, 
and  a  medical  advisory  committee.  After  the  final  committee  decision,  an  appeals 
mechanism  is  normally  available,  if  necessary. 

2.  The  Basic  Foundations  for  Medical  Care  Peer  Review  Model 

The  following  series  of  steps  is  representative  of  the  claims  review  process  at 
a  Foundation  for  Medical  Care.  Claims  are  reviewed  initially  by  general  clerks  who 
check  for  accuracy,  completeness,  and  eligibility.  A  review  clerk  then  checks  each 
claim  against  Foundation-developed  guidelines  to  screen  out  those  claims 
requiring  further  investigation.  Approximately  1 5-20  percent  of  all  claims  require 
further  investigation,  and  move  on  to  the  peer  review  process.  Members  of  the 
Foundation  are  appointed  as  review  physicians  on  a  rotating  basis.  When  a  review 
physician  receives  a  claim,  he  may  approve  it  or  ask  for  more  information.  If  he 
cannot  settle  the  claim,  it  is  then  sent  to  a  formal  Peer  Review  Committee  (less 
than  2  percent  of  all  claims  go  to  this  Committee).  If  further  discretionary  action 
is  required,  the  claim  is  then  sent  to  the  County  or  State  Medical  Society 
Grievance  Committee  for  final  decision.  The  appeals  mechanism  usually  follows 
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these  five  steps:  (1)  Re-review  by  the  Peer  Review  Committee;  (2)  Foundation 
Board  of  Trustees;  (3)  County  Medical  Society;  (4)  State  Medical  Association;  (5) 
The  judicial  process. 

3.  The  San  Diego  Foundation  Model 

For  this  model  of  claims  review,  San  Diego  area  physicians  have  developed 
community  norms  and  patterns  of  care  to  judge  the  propriety  of  claims.  Clerical 
review  of  all  claims  against  the  estabhshed  criteria  is  the  first  step  in  the  process, 
with  selection  for  further  review  of  those  claims  not  meeting  the  guidelines.  A 
physician  reviewer  sees  the  claims  in  his  own  specialty  that  were  selected  by  the 
above  process,  and  may  take  a  number  of  actions,  including  approval,  reduction 
of  fee,  request  for  additional  information,  reduction  of  the  total  claim  due  to 
identification  of  an  unnecessary  service,  and  referral  of  the  claim  to  team  review 
or  major  review.  Team  review  is  accomplished  by  one  of  five  teams  composed  of 
ten  physicians  each  that  meet  on  a  rotating  basis  to  review  complex  claims 
involving  total  billing  patterns.  Major  review  is  performed  by  a  single  committee 
and  is  responsible  for  review  of  cases  of  serious  overutilization  or  constant 
deviation  from  community  patterns. 

Physicians  in  this  system  of  claims  review  begin  as  medical  reviewers,  move 
up  to  team  review,  and  eventually  participate  in  major  review.  An  additional 
feature  of  the  San  Diego  model  is  its  use  as  an  educational  tool  by  the  practice  of 
inviting  physicians  who  exhibit  questionable  utilization  practices  to  sit  in  on  the 
claims  review  process. 

4.  The  San  Joaquin-Kern-Fresno  Model 

This  is  a  model  of  claims  review  via  local  peer  review,  and  is  currently  used  in 
connection  with  Medicare  Part  B  claims  by  the  three  named  Foundations.  Each 
foundation  supplies  its  data  to  San  Joaquin,  where  it  is  consoUdated  and 
re-distributed.  Patient  profiles  are  produced  every  two  weeks  and  physician 
profiles  every  month,  and  are  used  in  the  claims  review  process  for  review  of  fees 
and  utilization.  The  process  is  as  follows:  first,  a  reviewer  checks  claims  against 
fee  and  utilization  norms,  and  forwards  all  claims  falling  outside  the  guidelines  for 
medical  review.  In  addition,  all  claims  involving  certain  diagnoses  or  certain 
physicians  are  also  forwarded.  In  total,  33-60  percent  of  all  claims  are  forwarded. 
The  next  step  is  review  by  a  medical  consultant,  who  makes  a  decision  if  possible 
or  forwards  the  claim  to  a  senior  consultant.  If  the  senior  consultant  still  cannot 
resolve  the  claim,  the  next  step  is  a  medical  committee  composed  of  all  the 
medical  consultants,  followed,  if  need  be,  by  review  at  the  County  Medical 
Society  Level. 
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While  at  San  Joaquin  and  Kern,  claims  are  submitted  by  providers  on  a  daily 
basis,  the  Fresno  foundation  maintains  a  unique  approach  that  warrants 
discussion.  At  Fresno,  a  physician  taking  Medicare  claims  on  assignment  may 
submit  his  claims  only  once  per  month.  With  this  system,  a  single  reviewer  can  see 
all  the  claims  of  a  given  physician  at  one  time,  making  identification  of 
abnormahties  relatively  simple.  Fresno's  self-assessment  of  the  program  is  that  it  is 
extremely  effective  and  eliminates  the  need  for  case  by  case  review  of  patient  and 
physician  profiles.  Since  assignments  represent  80  percent  of  all  Medicare  claims, 
savings  achieved  by  this  approach  may  be  very  significant. 

The  results  of  this  claims  review  model  have  been  extremely  encouraging:  20 
percent  savings  in  the  first  year  of  operation,  and  14  percent  in  the  second  year. 
Of  this  14  percent,  it  is  interesting  to  note  that  12  percent  of  it  is  attributed  to 
utilization  savings  and  only  2  percent  to  fee  review. 

5.  The  Hennepin  County  Foundation  for  Health  Care  Evaluation  Model 

This  foundation-based  model  differs  from  the  San  Joaquin  model  in  terms  of 
its  usage  of  minimum  standards,  relationship  with  the  insurance  industry,  and 
peer  review.  Insurance  carriers  underwrite  the  administrative  overhead  of  the 
Foundation  and  are  responsible  for  initial  review  and  screening  of  claims.  During 
this  initial  screening,  the  insurance  carriers  are  required  to  use  UCR  fee  guidelines 
and  criteria  of  care  parameters  developed  by  the  Foundation.  The  UCR  fee 
guidelines  are  developed  from  fee  profiles  of  participating  physicians  and  use  the 
84  percent  cut-off  level;  a  level  chosen  so  that  the  Foundation  can  review  enough 
claims  to  be  considered  effective  without  overburdening  itself.  The  criteria  of 
care,  developed  by  physicians  representing  22  major  surgical  and  medical 
specialties,  are  contained  in  the  Book  of  Medical  Care  Norms  and  cover  over  220 
inpatient  and  outpatient  conditions.  Review  of  a  claim  by  the  Foundation  can  be 
requested  by  the  insurance  carrier,  the  physician,  or  the  patient,  but  most  reviews 
are  requested  by  the  carrier. 

The  process  of  claims  review  is  conducted  in  the  following  manner.  Standard 
claims  forms  are  sent  from  the  provider  to  the  appropriate  insurance  agency, 
where  they  are  checked  against  the  Foundation's  medical  and  fee  norms.  If  the 
claim  conforms  to  the  norms,  it  is  paid;  if  not,  it  is  sent  to  the  Foundation  for 
review  with  notification  sent  to  the  provider  that  the  claim  has  been  sent  to  the 
Foundation.  The  Foundation  review  process  begins  with  directing  the  claim  to 
one  of  two  Foundation  sections,  the  inpatient  hospital  section  or  the  ambulatory 
care  and  fee  section.  Because  the  physician  is  not  identified  on  the  claims  form, 
the  review  process  treats  members  and  non-members  equally.  The  first  step  is 
review  by  an  individual  physician  of  the  same  specialty  field  that  the  claim 
represents.  If  additional  medical  information  is  needed,  the  reviewer  obtains  it.  If 
the  problem  is  only  a  matter  of  fee,  the  fee  is  reduced  to  the  maximum  guideline 
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and  paid.  When  the  reviewer  feels  he  cannot  adequately  settle  the  claim,  the  claim 
goes  before  the  entire  Peer  Review  Panel.  The  panel  is  composed  of  21  physicians 
representing  21  specialties,  meets  once  a  week,  and  has  a  target  case  load  of  20. 
At  the  Peer  Review  Panel  meeting,  cases  are  parcelled  out  to  the  appropriate 
specialist  on  the  panel.  The  specialist  then  presents  the  case  to  the  entire  panel 
with  the  recommendations  of  the  first  physician  reviewer  and  his  own 
recommendations.  The  panel  makes  a  final  decision  and  notifies  the  carrier  and 
the  physician  of  the  judgment. 

Initial  results  of  the  Foundation's  program  are  promising:  for  the  nine 
month  period  June  1971  —  March  1972,  57.4  percent  of  claims  received  were 
reduced,  resulting  in  a  substantial  cost  saving. 

6.  The  Kansas  Blue  Cross-State  Peer  Review  Model 

This  model  of  claims  review  services  Kansas  Blue  Cross  and  Blue  Shield, 
Medicare,  Medicaid,  and  the  federal  program  for  dependents  of  servicemen 
(CHAMPUS).  Historical  data  on  claims  and  utilization  are  used  to  generate  review 
norms.  Claims  are  initially  sent  to  the  computer  for  review  against  the  Plan's 
norms.  All  abnormal  claims  are  then  classified  into  one  of  two  groups:  fees  or 
overutilization.  The  Classified  claims  are  then  sent  to  a  review  group  composed  of 
five  physicians,  which  reviews  the  claim  and  attempts  to  adjudicate  it  by  direct 
contact  with  the  physician  involved.  If  the  claim  is  not  settled  in  this  manner,  it  is 
sent  to  one  of  four  state  peer  review  committees,  which  may  approve,  ask  for 
further  information,  disallow  in  part  or  in  total,  or  send  the  claim  to  one  of 
eighteen  local  peer  review  groups.  The  latter  action  is  taken  most  often  when 
fraud  or  departure  from  community  patterns  is  suspected.  The  local  peer  review 
committee,  in  turn,  places  special  emphasis  on  identifying  fraud  or  substantial 
deviation  from  community  norms.  If  such  a  finding  is  made,  the  local  peer  review 
committee  may  resolve  the  case  by  direct  contact  with  the  physician,  referral 
back  to  the  state  peer  review  committee,  or  appeal  to  the  state  Healing  Arts  Board 
for  possible  filing  of  charges  for  revocation  of  the  physician's  license.  The  appeals 
process  follows  three  steps:  (1)  reconsideration  by  the  state  peer  review 
committee;  (2)  referral  to  the  Blue  Shield  Executive  Committee  for  a  decision;  (3) 
referral  to  the  Kansas  Medical  Society  for  a  recommended  solution  (which  is 
accepted  by  the  Blue  Shield  Executive  Committee  by  established  precedent). 

7.  The  Mississippi  EMCRO  Model 

The  review  of  hospital  and  physician  care  forms  the  basis  for  this  model. 
Sixteen  of  the  eighteen  existing  Mississippi  subspecialty  societies  developed 
criteria  for  inpatient  diagnoses  to  be  used  as  a  basis  for  selecting  claims  for  closer 
review.  These  criteria  included  the  circumstances  indicating  the  need  for  hospital 
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admission,  the  usual  services  provided,  the  services  consistent  (even  if  not  usually 
provided)  with  each  diagnosis,  the  expected  length  of  stay  without  complications, 
and  the  conditions  that  may  increase  the  length  of  stay  beyond  that  expected. 
Data  on  cases  to  be  reviewed  is  abstracted  from  the  patient's  medical  record  by 
the  medical  records  hbrarian  at  each  hospital  and  input  to  a  computer  which 
performs  the  comparison  with  the  criteria  discussed  above.  If  deviations  from  the 
criteria  are  found,  the  computer  first  scans  the  data  for  input  error.  If  none  is 
found,  the  case  is  sent  to  a  reviewing  physician  or  the  utilization  review 
committee.  While  this  model  is  currently  used  for  utilization  review  rather  than 
claims  review,  its  applicabihty  in  supporting  claims  review  is  apparent.  The 
uniqueness  of  the  model  lies  in  its  use  of  data  from  medical  records  rather  than 
claims  forms. 

8.  The  Mississippi  Verification  Model 

Claims  review  in  this  model  is  performed  with  the  unique  approach  of  spot 
check  verification  of  claims  by  site  visits.  Site  visits  to  physicians  involve  a  check 
of  the  physician's  records  for  the  patient's  name  and  social  security  number,  the 
date  of  the  visit,  the  principal  problem,  and  the  diagnosis  and  treatment,  against 
the  claim  filed.  Hospital  verification  involves  a  check  of  medical  records  for 
completeness;  the  existence  of  a  plan  for  post-hospital  care;  and,  the  existence  of 
physician  statements  of  need  and  recertification.  Spot  checks  at  nursing  homes 
center  on  similar  data  in  the  medical  record.  In  pharmacies,  the  existence  of 
signed  prescriptions  and  refill  orders  is  ascertained.  Although  the  Mississippi  audit 
is  not  currently  based  on  singling  out  questionable  claims  for  site  visit  review,  it 
can  certainly  be  geared  to  that  concept  without  much  difficulty. 

9.  The  New  York  Medicaid  Surveillance  and  Enforcement  System 

Although  this  system  employs  a  variety  of  aforementioned  claims  review 
methods,  its  use  of  patient  re-examination  as  a  claims  review  technique  is  of 
interest  (106, 107).  In  the  course  of  treatment,  certain  patients  are  provided  with 
physical  aids,  prosthetic  devices,  and  other  types  of  medical  appliances.  Such 
patients  can  be  examined  not  only  for  purposes  of  verification  of  actual  receipt  of 
appliances  listed  on  claims  forms,  but  also  for  evaluation  of  appropriateness  of 
care.  The  New  York  Medicaid  program  currently  examines  patients  who  have 
been  treated  by  optometrists,  podiatrists,  dentists,  and  opthalmologists,  and  is 
considering  examination  of  patients  who  have  received  hearing  aids  and  artificial 
limbs. 

The  claims  review  process  works  in  the  following  manner.  All  claims 
involving  patients  who  fall  in  the  above  re-examination  categories  are  grouped 
together,  and  random  samples,  sized  to  meet  the  re-examination  capabilities  of 
the  program,  are  drawn  with  stratification  by  geographical  location.  Invitations  to 
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the  patients  are  then  sent  out,  asking  for  their  cooperation  in  the  review  process. 
The  patients  are  then  examined  by  physicians  in  the  appropriate  field,  who  record 
and  send  their  findings  to  supervisors  who  compare  the  original  claims  with  them 
and  reach  a  decision  concerning  provision  and  quality  of  claimed  services.  A  third 
physician  then  renders  a  final  judgment  on  the  case,  and  modification  of  the  claim 
is  made  if  warranted.  If  patterns  of  modified  claims  for  individual  physicians  arise, 
a  complete  investigation  of  the  physician  is  made. 

10.  The  California  On-Going  Claims  Review  Model 
(Medi-Cal  Management  System) 

This  system  has  been  developed  for  the  simple  reason  that  optimal  use  of  a 
review  organization's  time  and  talents  can  be  made  by  having  the  review 
organization  adjudicate  only  exception  claims,  rather  than  all  claims.  The  State  of 
California  asked  the  California  Foundations  to  develop  medical  criteria  programs 
for  the  project,  including  criteria  for  usual  treatment  patterns,  consistency  of 
amounts  and  types  of  inpatient  services,  drugs,  and  ancillary  services.  In  addition, 
the  criteria  were  reviewed  by  various  national  medical  associations  before  final 
approval. 

Current  plans  call  for  the  computer  to  perform  both  administrative  and 
medical  review  of  claims.  As  a  first  step,  claims  are  sent  to  local  input  centers  for 
entrance  into  the  system.  The  computer  first  checks  for  errors  in  administrative 
coding  and  eligibility.  If  the  claim  is  accurate,  it  moves  to  a  medical  review  section 
for  a  similar  check  on  medical  coding,  followed  by  actual  medical  review.  For 
medical  review,  the  claim  is  first  checked  against  what  is  termed  a  Broad  Screen  to 
eUminate  very  simple  claims  involving  visits  not  requiring  comparison  with  the 
Model  Treatment  Patterns  criteria.  If  a  claim  is  eliminated  in  this  manner,  it  is 
paid  and  the  information  is  recorded  for  patient  and  provider  profiles.  If  not,  the 
claim  is  sent  to  the  Program  for  Model  Treatment  Patterns  for  review.  If  the 
patient's  treatment  conforms  to  a  model  treatment  pattern,  it  is  paid  and 
information  for  profiles  is  recorded.  Should  the  claim  not  conform  to  a  model 
pattern  it  is  flagged  for  manual  review  and  accompanied  by  statements  issued  by 
the  computer  regarding  the  reasons  for  rejection  and  by  the  patient's  profile.  The 
local  peer  review  mechanism  handles  the  remainder  of  the  adjudication  process. 

While  little  mention  is  made  of  the  patient  and  provider  profiles  in  the  above 
process,  it  is  rea:,onable  to  conclude  that  in  addition  to  the  steps  mentioned, 
checks  against  patient  profiles  are  made  for  similar  past  experiences,  and  checks 
against  physician  profiles  are  made  for  fee  determination,  with  appropriate 
actions  taken  as  necessary.  One  of  the  strongest  arguments  for  this  system  is  its 
attempt  to  make  inroads  to  the  problem  of  underutihzation  with  the  Model 
Treatment  Pattern  Program. 
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11.  The  University  of  Alabama  On-Line  Medicaid  Claims  Processing  Model 

Currently  in  the  developmental  stage,  this  model  hopes  to  use  standard 
numeric  keyboard  card  reader  telephones  as  remote  computer  terminals  (155). 
Providers  will  be  able  to  enter  Medicaid  claims  information  at  the  point  of  care, 
bypassing  a  great  deal  of  paperwork,  and  in  addition,  use  the  system  for  retrieval 
of  information  about  patient  eUgibility  and  extent  of  coverage.  Proposed 
capabilities  of  the  system  will  include  on-line  acceptance  of  claims  information 
from  telephone  equipment,  on-line  editing  of  input  data  for  accuracy  with  an 
appropriate  response  mechanism,  and  on-line  responses  to  inquiries  regarding 
eligibility,  days  of  coverage  remaining,  visits  remaining,  and  other  topics,  from 
providers,  fiscal  intermediaries,  and  the  Medicaid  Information  Office  of  Alabama. 

12.  The  Blue  Cross/Blue  Shield  Claims  Linkage  System 

Blue  Cross  and  Blue  Shield  are  currently  working  on  a  combined  claims 
administration  system.  Four  difficulties  must  be  overcome  to  make  the  venture  a 
success.  These  are  incompatibility  of  data  bases,  electronic  data  processing 
restrictions,  contract  differences,  and  time  differences  in  submission  of  claims 
between  physicians  and  hospitals.  The  rationale  for  the  system,  however,  makes 
excellent  sense  in  expressing  a  philosophy  of  claims  review  that  may  be  quite 
forward-looking:  that  maximum  efficiency  and  impact  via  claims  review  can  only 
be  achieved  by  integrating  patient,  physician,  and  hospital  profiles  to  analyze  the 
entire  patient  experience. 

13.  The  Philadelphia  Blue  Cross  Model 

This  model  of  claims  review  applies  only  to  hospital  billings  and  was 
instituted  in  1971  to  handle  Medicare  and  FEHBPUS.  Claims  are  tagged  for 
review  if  length  of  stay  is  inconsistent  with  the  diagnosis  or  services  delivered,  if 
length  of  stay  exceeds  a  specified  limit  (somewhere  between  the  50th  and  75th 
PAS  percentiles),  if  hospitalization  appears  unnecessary,  or  if  the  claim  fits  other 
normal  patterns  of  cases  subject  to  review. 

When  a  claim  has  been  identified  as  requiring  investigation,  the  utilization 
review  committee  of  the  institution  to  which  the  claim  is  connected  is  contacted 
and  asked  to  review  the  case  within  20  days.  The  patient's  physician  is  asked  to 
do  the  same.  Both  the  physician  and  hospital  utilization  review  committee  must 
respond  in  writing,  attaching  appropriate  sections  of  the  patient's  medical  record 
with  justification  for  treatment.  When  the  responses  have  been  received,  they  are 
forwarded  along  with  the  claim  for  review  by  Blue  Cross  physicians. 
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Results  of  the  program  have  been  encouraging:  Medicare  investigation  and 
rejection  rates  have  doubled,  from  0.8  percent  to  1.6  percent.  While  hospital 
utilization  review  committees  have  been  able  to  fully  agree  with  Blue  Cross  in 
over  33  percent  of  claims  being  investigated,  they  have  voiced  the  objection  that 
an  additional,  though  not  undue,  burden  has  been  placed  upon  them.  One 
possible  modification  of  this  model  that  has  been  suggested  would  be  to  include 
the  summary  sheet  from  the  patient's  medical  record  at  the  time  the  claim  is 
submitted.  This  modification  might,  in  some  cases,  save  the  entire  investigative 
process  and  delay  in  settlement  that  currently  exists. 

14,  Tulsa  Blue  Cross  —  Hospital  Utilization  Review  Committee  Model 

This  model  of  claims  review  combines  prospective  review  with  cooperation 
between  Blue  Cross  and  participating  hospitals,  and  has  had  dramatic  success  since 
implementation  (155).  Under  this  program,  each  patient  admitted  to  a  partici- 
pating hospital  is  assigned  a  certain  number  of  pre-approved  days  of  stay  (PAD) 
based  on  the  PAS  Regional  75th  percentile.  Two  days  before  the  patient  PAD  is 
reached,  the  patient's  physician  must  request  certification  for  continued  stay  in 
writing.  The  request  for  certification  must  be  reviewed  immediately  by  at  least 
one  member  of  the  hospital  utilization  review  committee;  if  approved,  certifica- 
tion is  given  up  to  a  maximum  of  the  90th  PAS  percentile.  The  same  procedure 
may  be  repeated  again,  with  the  95th  PAS  percentile  as  a  maximum.  If  the 
patient's  stay  is  to  exceed  the  95th  percentile,  the  entire  hospital  utilization 
review  committee  must  review  the  case. 

The  focus  of  this  project  has  been  on  cost  and  reduction  of  inappropriate 
utilization  of  hospital  resources.  In  the  first  year  of  the  project,  average  length  of 
stay  dropped  more  than  four  days  in  each  of  the  two  participating  hospitals,  repre- 
senting percentage  reductions  in  the  neighborhood  of  30  percent. 

15.  The  Rhode  Island  Blue  Cross  —  Hospital  Utilization  Review  Committee 
Cooperative  Model 

A  three-tiered  process  forms  the  basis  for  this  claims  review  model.  At  level 
one,  claims  are  divided  into  surgical/non-surgical  categories  and  reviewed  against 
internally  established  standards  and  norms.  If  a  claim  is  flagged  for  further  review 
at  level  one,  it  is  automatically  returned  to  the  hospital  for  additional 
information,  after  which  level  two  review  occurs.  Level  two  review  is  based  on  a 
patient's  previous  claims  experience  as  well  as  the  current  claim  in  question.  If 
satisfactory  settlement  of  the  claim  cannot  occur  at  level  two,  level  three  review 
commences.  In  this  stage  of  review,  the  Blue  Cross  Medical  Director  and  the 
hospital  utilization  review  committee  work  separately  in  evaluating  the  case. 
Although  the  Blue  Cross  Medical  Director  is  responsible  for  the  final  decision,  the 
evaluation  of  the  hospital  utilization  review  committee  is  given  appropriate 
consideration. 
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16.  The  Blue  Cross  Medical  Advisory  Committee  —  Hospital  Utilization 
Review  Committee  Cooperative  Model 

This  model  has  set  up  criteria  for  the  claims  review  process  itself.  These 
criteria  include: 

(a)  Use  of  input  data  from  standard  claims  forms  or  abstracts  of  medical 
records 

(b)  Regionally  established  norms,  standards,  and  parameters 

(c)  Professional  review  of  claims  selected  for  review 

(d)  Appeal  mechanism 

(e)  Claims  with  two  or  more  certifications  to  go  directly  to  upper  level 
review. 

While  the  first  four  criteria  have  been  implicitly  included  in  many  of  the 
claims  review  models  already  discussed,  the  last  criterion  has  not  been  heretofore 
mentioned,  and  suggests  that  in  certain  circumstances,  the  formal  steps  toward  an 
ultimate  decision  ought  to  be  circumvented  to  speed  the  claims  processing 
function. 

17.  The  Kansas  Blue  Cross  —  Hospital  Utilization  Review  Committee  Model 
(Topeka  Cooperative  Plan) 

The  Topeka  Cooperative  Plan  has  set  up  guidelines  for  cooperative  models  of 
claims  review  such  as  are  discussed  in  this  paper.  These  guidelines  are  listed  below. 

(a)  Criteria,  norms,  patterns  of  care,  and  parameters  of  review  should  be 
mutually  acceptable. 

(b)  A  review  of  each  extension  beyond  the  initial  precertified  length  of  stay 
should  be  performed  as  soon  as  possible.  If  an  adverse  recertification 
decision  is  reached,  appropriate  advance  notice  should  be  given  so  that 
recertification  will  be  denied. 

(c)  Monthly  reports  should  be  submitted  to  the  third  party  by  the  hospital 
utilization  review  committee,  including  individual  reports  on  each  case 
involving  a  denial  of  recertification.  If  the  patient  decides  to  stay  in  the 
hospital  past  the  approved  length  of  stay  even  though  recertification 
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has  been  denied,  the  patient  should  be  informed  that  he  will  be 
personally  responsible  for  payment  for  the  additional  hospital  care,  and 
the  hospital  should  show  any  charges  for  the  additional  time  period  as 
non-covered  charges. 

(d)  An  appropriate  alternative  level  of  care  should  be  noted  on  all  denials. 

(e)  Site  visits  should  be  made  by  the  third  party  for  liaison  and 
communication  purposes,  including  meetings  with  the  utiUzation  review 
committee. 

(0  Review  of  claims  approved  by  the  hospital  utilization  review  committee 
should  be  made  independently  by  professionals  employed  by  the  third 
party,  in  order  to  ascertain  the  effectiveness  of  the  cooperative  model's 
reliance  on  the  utilization  review  committee. 

In  summary,  a  number  of  advantages  accrue  to  both  the  third  party  and  the 
hospital  from  the  use  of  a  cooperative  claims  review  model.  These  advantages 
include  a  centralized  place  of  review  for  each  hospital  instead  of  a  central  third 
party  committee  for  all  hospitals;  involvement  of  many  physicians  in  the  claims 
review  process;  abiUty  to  review  more  cases;  emphasis  placed  on  effective  use  of 
hospital  resources,  not  just  individual  claims  resolution;  and  a  two-way  flow  of 
information  and  guidance.  It  is  hoped  that  an  increase  in  productivity  and 
hospital  efficiency  will  be  the  end  result  of  the  use  of  a  cooperative  model  of 
claims  review. 

18.  The  Sacramento  Foundation  Certified  Hospital  Admission  Program  (CHAP) 
Model 

CHAP  incorporates  prospective  review  into  the  claims  review  function  where 
a  physician  must  submit  an  apphcation  for  certification  of  hospital  admission  to 
the  Program  together  with  information  concerning  the  patient's  current  medical 
condition  (19).  A  CHAP  reviewer,  either  a  nurse  coordinator  or  an  M.D. 
Certification  Consultant,  reviews  the  apphcation  and  if  appropriate,  certifies  an 
approved  length  of  stay  PAS  (50th  percentile)  for  the  admission  diagnosis.  After 
admission  ,  a  Nurse  Coordinator  concurrently  confirms  the  diagnosis,  follows  the 
patient's  progress,  and  attempts  to  identify  changes  in  the  patient's  condition  that 
might  require  a  change  in  the  certified  length  of  stay.  If  an  extension  of  the 
approved  length  of  stay  is  needed,  it  must  be  requested  by  the  patient's  physician 
and  approved  by  a  CHAP  physician  reviewer.  After  the  patient  is  discharged,  a 
claim  is  submitted  with  a  CHAP  certification  form  attached.  The  claim  is  paid 
without  further  delay  if  accompanied  by  a  CHAP  approved  form.  A  variation  of 
this  last  step  is  found  in  a  program  similar  to  CHAP,  the  AID  (Approval  by 
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Individual  Diagnosis)  Program  in  New  Jersey  (66),  where  final  payment  of  the 
claim  is  not  made  routinely,  but  depends  instead  on  whether  the  discharge 
diagnosis  and  the  admitting  diagnosis  are  identical. 

At  the  time  when  CHAP  was  first  implemented,  the  last  step  did  not  occur 
without  insurance  carrier  verification  of  the  CHAP  decision.  Now,  however,  the 
carriers  involved  have  seen  satisfactory  evidence  of  CHAP's  ability  to  perform  the 
review  process,  with  the  result  that  they  have  eliminated  their  own  audit  of 
CHAP's  decisions.  A  similar  process  of  carrier  verification  ought  to  be  expected 
when  implementing  programs  similar  to  CHAP  in  other  parts  of  the  country. 

Under  CHAP,  no  restrictions  are  placed  on  choice  of  providers  due  to 
CHAP's  widespread  support  by  the  medical  profession  and  insurance  carriers  in 
the  Sacramento  area.  Moreover,  its  twin  policies  of  aiming  at  discharge  prior  to 
the  certified  length  of  stay  and  denying  original  certification  unless  medically 
necessary,  can  be  shown  to  have  achieved  excellent  results.  Under  CHAP's 
commercial  insurance  program  a  27.1  percent  reduction  in  hospital  days  has  been 
observed,  and  under  its  Medi-Cal  program,  a  25  percent  reduction  in  average 
length  of  stay.  Finally,  CHAP  claims  are  expedited  significantly,  leading  to  rapid 
reimbursement  to  providers. 

19.  The  New  Mexico  Foundation  for  Medical  Care  Model 

This  model  of  claims  review  combines,  on  a  statewide  basis,  procedures  for 
claims  review  similar  to  those  developed  at  the  San  Joaquin  Foundation  for 
Medical  Care  with  a  precertification  program  similar  to  CHAP  administered  by  the 
New  Mexico  Foundation.  In  addition,  the  New  Mexico  Foundation  is  developing 
criteria  for  four  different  levels  of  nursing  home  care  to  be  used  in  a  program  of 
prospective  nursing  home  review.  Use  of  the  model  is  currently  limited  to 
Medicaid  claims.  The  criteria  that  form  the  basis  of  the  review  were  formulated  by 
panels  of  local  physicians,  and  are  used  in  connection  with  hospital  services, 
physician  services,  and  drugs. 

For  hospital  services,  prospective  review  of  elective  admissions  and  con- 
current review  of  emergency  admissions  is  conducted  using  the  Hospital 
Admission  Precertification  Program  (HAPP).  Physicians  request  initial  certifica- 
tion by  sending  an  appUcation  to  the  Foundation.  If  the  request  is  within  the 
guidelines  of  the  Foundation,  and  is  justified  by  the  patient's  medical  history,  a 
length  of  stay  (PAS  50th  percentile)  is  certified.  If  not,  the  request  is  sent  to  a 
HAPP  reviewing  physician  who  may  approve,  disapprove,  ask  for  more  informa- 
tion, refer  the  request  to  a  specialist,  adjust  the  request,  or  refer  it  to  the  full 
HAPP  Review  Committee. 
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If  the  patient  needs  to  remain  in  the  hospital  longer  than  the  initial 
authorized  length  of  stay,  recertification  is  carried  out  by  the  utilization  review 
committee  of  the  hospital  in  question,  a  feature  that  distinguishes  this  program 
from  CHAP.  If  the  utilization  review  committee  approves  the  request  for 
extension,  the  approved  length  of  stay  is  extended  to  the  75th  PAS  percentile  and 
the  Foundation  is  notified.  The  same  procedure  must  be  followed  for  all  further 
extensions.  While  the  hospital  utilization  review  committee  has  the  initial  say  on 
matters  of  extension,  the  Foundation  monitors  their  decisions  and  has  the  final 
authority  to  approve  or  disapprove  extensions. 

An  appeal  mechanism  is  available  if  a  hospital,  physician,  or  patient  wishes 
to  appeal  a  HAPP  decision.  The  appeal  steps  are  as  follows:  (1)  Re-review;  (2)  full 
HAPP  committee;  (3)  Foundation  Board  of  Directors;  (4)  New  Mexico  Profes- 
sional Association  Council;  (5)  HSSD  Medicaid  division;  (6)  HSSD  Board  of 
Directors;  and  (7)  the  courts. 

For  physician  services,  guidelines  for  initial  claim  processing  have  been 
established  for  approximately  170  diagnoses.  The  claim  is  first  reviewed  manually 
against  the  guidelines  by  properly  trained  and  reliable  claims  processors. 
(Computerization  of  this  process  is  seen  in  the  near  future  when  the  criteria  and 
data  processing  equipment  become  more  sophisticated.)  If  the  claim  is  ques- 
tioned, it  is  sent  to  a  review  physician,  who  may  approve  the  claim,  reject  it,  or 
refer  it  to  a  Professional  Review  Committee.  It  is  hoped  that  10—20  percent  of  all 
physician  claims  will  be  reviewed  for  exceptions  with  less  than  one  percent  being 
referred  to  the  Professional  Review  Committee.  Claims  processing  for  drugs  is 
entirely  automated. 

Because  data  processing  equipment  is  used  quite  extensively  in  this  claims 
review  process,  the  way  in  which  it  interfaces  with  claims  reviewers  and  physicians 
is  of  interest.  When  claims  are  received,  they  are  first  microfilmed,  then  sent  to 
clerical  reviewers.  Drug  claims  are  inspected  for  accuracy,  and  a  physician 
identification  number  is  added.  Hospital  and  physician  claims  are  inspected  for 
accuracy  and  adherence  to  guidelines,  and  appropriate  service  codes  are  added. 
The  data  is  then  entered  into  the  computer  system,  which  features  an  on-line 
payments  system  and  CRT  equipment  for  computer-reviewer  communication. 
The  computer  checks  patient  and  provider  eligibility,  duplication  of  claims,  and 
verifies  coverage  for  services  claimed.  If  a  claim  is  rejected  for  accuracy  reasons,  it 
is  sent  to  an  audic  group  for  manual  correction  of  errors.  If  not,  the  claim  is 
priced,  and  paid  if  accepted.  If  initial  review  indicates  that  a  claim  should  be 
reviewed  by  a  physician,  the  physician  examiner  reviews  the  claim  in  conjunction 
with  CRT  display  of  patient  and  provider  profiles,  and  can  then  instruct  the 
computer  to  pay,  adjust,  reject,  or  designate  the  claim  for  full  committee  review. 
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All  orders  to  pay  claims  are  stored  in  the  computer's  memory,  and  on  payment 
date  are  retrieved,  sorted  by  provider,  and  paid.  Claims  designated  for  further 
review  are  sorted  by  specialty. 


Prehminary  results  of  this  program  indicate  a  cost  savings  of  10—20  percent 
for  the  New  Mexico  Medicaid  program.  The  savings  have  been  used  to  reinstate 
benefit  provisions  removed  earher,  and  have  served  as  evidence  to  physicians  of 
the  efficiency  of  the  Medicaid  program,  thus  increasing  physician  participation  in 
the  program. 

20.  The  Colorado  Model 

This  model  of  prospective  claims  review  for  Medicaid,  named  the  Colorado 
Hospital  Admission  Program,  is  quite  similar  to  the  Sacramento  CHAP  model. 
When  physicians  request  the  admission  of  their  patients,  the  hospital  normally 
admits  the  patient  and  determines  an  expected  length  of  stay  based  on  PAS 
statistics  adjusted  for  age  and  diagnosis  (multiple  or  single,  medical  or  surgical). 
At  this  time,  a  form  is  sent  to  the  involved  third  party  for  verification  of  the 
allotted  length  of  stay.  If  an  extension  is  needed,  it  must  be  requested  by  the 
physician,  approved  by  the  hospital  utilization  review  committee  (at  least  one 
member),  and  approved  by  the  state.  State  approval  is  normally  given  by  a  phone 
call  followed  by  a  written  confirmation.  In  addition,  extensions  must  be  sought 
and  granted  before  the  end  of  the  first  approved  length  of  stay.  If  they  are  not,  no 
payment  is  made  for  any  days  of  stay  incurred  while  waiting  for  a  late 
recertification. 

Appeals  procedures  are  available  if  either  the  hospital  utilization  review 
committee  or  the  state  refuse  to  recertify.  If  the  hospital  refuses  and  the 
physician  agrees  but  the  patient  wishes  to  stay,  the  problem  is  handed  over  to  the 
department  of  public  welfare.  If  the  physician  disagrees,  the  case  is  brought  to  the 
Regional  Review  Committee  and  proceeds  through  the  state  review  mechanism.  If 
the  state  refuses  to  recertify,  appeal  is  made  to  the  State  Peer  Review  Committee, 
whose  decision  is  binding. 

The  model  has  not  been  without  problems,  as  might  be  expected.  Physicians 
are  unhappy  with  the  paperwork  involved,  and  resent  the  state  questioning  their 
judgment.  In  addition,  problems  with  PAS  statistics  have  led  to  the  prospect  of 
developing  standards  exclusively  for  Colorado.  Nevertheless,  there  are  demon- 
strable savings  for  fiscal  year  1971.  Moreover,  two  important  criteria  for  any 
claims  review  model  have  come  out  of  the  Colorado  experience.  These  are 
continual  evaluation  of  standards  selected,  and  involvement  of  all  concerned 
groups  starting  in  the  planning  stage  of  development. 
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21.  The  Illinois  Hospital  Admission  and  Surveillance  Program 

The  Illinois  model,  named  HASP,  is  a  prospective  review  mechanism  similar 
to  the  Colorado  model,  but  with  state,  regional,  and  local  HASP  committees. 
While  most  decisions  are  arrived  at  in  local  committee  meetings,  regional 
monitoring  exists  due  to  the  assertion  that  peer  review  on  a  local  level  may 
sometimes  be  influenced  by  personal  relationships.  Illinois  hopes  to  bring 
objectivity  to  the  process  of  claims  review  with  the  State-regional-local  committee 
structure. 

22.  Drug  Claims  Review:  General  Comments 

The  problems  with  claims  review  for  drugs  are  manifold,  revolving  around 
the  high  number  of  units  administered,  the  low  unit  costs,  and  the  expense  of 
data  gathering.  It  is  commonly  asserted,  in  fact,  that  the  costs  per  claim  would 
exceed  the  benefits  of  drug  claims  review  as  a  cost  control  mechanism.  Current 
data  processing  systems  nevertheless  offer  the  capability  of  producing  a  variety  of 
useful  drug  claims  information,  including  expenditures  for  individual  patients  over 
given  time  periods,  expenditures  for  individual  drugs  and  drug  categories  over 
given  time  periods,  benefits  paid  to  individual  pharmacies,  patterns  of  physician 
prescribing,  and  most  other  categories  readily  obtainable  from  data  manipulation. 
A  rather  unique  use  of  these  capabilities  is  discussed  in  the  following  section. 

23.  The  San  Joaquin  Drug  Claims  Model 

This  model  is  somewhat  unusual  due  to  its  emphasis  on  selecting  patients 
rather  than  claims  for  the  review  process.  Drug  claims  are  entered  into  the  entirely 
computerized  system,  from  which  patient  and  provider  profiles  are  developed. 
The  computer  then  selects  patients  for  review  if  inspection  of  the  patient  profile 
reveals  that  the  patient  meets  any  one  of  a  number  of  criteria.  These  criteria 
include: 

(a)  Patient  receives  more  than  a  certain  number  of  prescriptions  in  a  certain 
time  period 

(b)  Patient  receives  more  than  a  certain  number  of  prescriptions  in  a 
therapeutic  category  in  a  certain  time  period 

(c)  Patient  receives  more  than  a  certain  dollar  value  of  prescriptions  in  a 
certain  time  period 

(d)  Patient  visits  more  than  a  specified  number  of  physicians  in  a  certain 
time  period 


166 


Arthur  D  Little  Inc 


(e)  Patient  receives  prescriptions  from  more  than  a  specified  number  of 
pharmacies  in  a  given  time  period 

(f)  Patient  receives  similar  drugs  in  the  same  therapeutic  category  on  the 
same  day  at  more  than  one  pharmacy. 

All  profiles  of  patients  so  selected  are  reviewed  by  the  Drug  Utilization 
Review  Committee  on  a  regular  basis.  While  application  of  the  system  is  currently 
limited  to  patient  profiles,  a  similar  selection  process  with  appropriate  criteria  is 
also  feasible  using  provider  and  pharmacy  profiles. 

Summary  Comments 

This  section  will  summarize  the  major  attributes  of  the  claims  review  models 
discussed  in  this  paper;  an  attribute  will  be  Usted  even  if  it  applies  to  only  one  or 
two  models,  though  most  attributes  listed  will  apply  to  a  number  of  different 
models. 

1.  Review  of  hospital  utilization  and  services,  physician  services,  and  drug 
utilization,  for  individual  episodes  of  illness. 

2.  Overall  review  of  physician  and  patient  profiles  without  reference  to 
individual  claims. 

3.  Retrospective  review. 

4.  Criteria  for  selection  of  claims  for  further  review  include  utilization 
norms,  model  patterns  of  care,  certain  diagnoses,  certain  physicians. 

5.  Norms  and  review  guidelines  developed  by  local  or  regional  panels  of 
physicians,  reflecting  local  and  regional  practices. 

6.  Use  of  regional  length  of  stay  norms  developed  by  PAS. 

7.  Continual  evaluation  and  revision  of  norms  and  guidelines. 

8.  Three  to  five  levels  of  review. 

9.  Initial  review  conducted  by  clerical  personnel. 

10.  Manual  initial  review. 

1 1 .  Initial  review  by  computer. 
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12.  Initial  review  designed  to  identify  10-20  percent  of  claims  for  further 
review. 

13.  Second  and  subsequent  levels  of  review  conducted  by  nurses  or 
physicians,  usually  physicians. 

14.  Use  of  on-Hne  EDP  at  second  level  of  review. 

15.  Committees  of  physicians  for  upper  levels  of  review. 

1 6.  Rotating  physician  teams  for  upper  levels  of  review. 

17.  Local,  regional,  and  state  peer  review  committees  for  upper  levels  of 
review.  Order  of  claims  flow  not  necessarily  local  to  regional  to  state. 

18.  Classification  of  claims  by  specialty  for  review  by  physicians  at  upper 
levels. 

19.  Cooperation  between  hospital  utilization  review  committee  and  upper 
level  reviewers. 

20.  Less  than  2-percent  of  claims  to  reach  upper  level  review. 

21.  Availability  of  appeals  mechanism. 

22.  Analysis  of  entire  patient  experience  by  integration  of  review  of 
patient,  physician,  and  hospital  profiles  and  claims  forms. 

23.  Data  extracted  from  claims  forms  and  medical  records. 

24.  Data  verification  by  site  visitation. 

25.  On-line  input  of  claims  information  by  providers  at  place  of  business. 

26.  Verification  of  claims  by  re-examination  of  patients. 
IV.  COST  CONTROL  VIA  PUBLIC  REGULATION 

A.  REVIEW  OF  INSTITUTIONAL  PLANS 

Cost  control  attempts  generated  within  the  traditional  health  care  delivery 
system  may  ultimately  prove  ineffective  for  a  great  number  of  reasons,  the  most 
significant  of  which  is  non-optimal  individualistic  action  within  a  system  context. 
Such  behavior  is,  of  course,  common  to  all  systems  in  which  the  optimal  course  of 
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action  for  the  system  differs  from,  or  is  in  direct  conflict  with,  the  product  of  the 
optimal  courses  of  action  perceived  by  the  individual  components  of  the  system. 
This  problem  is  manifested  most  frequently  in  the  health  care  system  with  respect 
to  hospital  growth  and  expansion,  and  the  result  has  been  a  continuous  movement 
toward  public  regulation  of  hospital  construction  with  the  Hill-Harris  and 
Comprehensive  Health  Planning  legislation. 

Hospital  expansion  bears  directly  on  the  issue  of  rising  health  care  costs. 
Expansion  adds  operating  overhead,  increases  total  expenditures,  and  may 
increase  unit  costs.  Moreover,  expansion  may  be  in  no  one's  interest  if  adequate 
personnel  are  unavailable,  if  it  duplicates  existing  faciUties  for  which  demand 
cannot  support  a  multiplicity  of  units,  or  if  it  results  in  competition  with  other 
institutions  for  current  employees.  On  the  other  hand,  it  is  difficult  to  deny  the 
necessity  for  expansion  when  it  legitimately  adds  to  the  supply  of  beds  or 
services,  or  when  it  results  in  the  replacement  of  worn  or  out-moded  equipment. 
The  problem  arises  from  the  fact  that  individual  hospitals  cannot  be  trusted  to 
evaluate  the  needs  of  the  community;  it  is  very  difficult  for  them  to  shed  their 
individuality  and  act  in  an  objective  manner. 

The  Hospital  Survey  and  Construction  Act  of  1946  (Hill-Harris)  attempted 
to  deal  with  this  situation.  The  legislation  contained  three  important  systems  — 
oriented  principles,  including  the  need  for  a  survey  of  a  community's  needs  before 
undertaking  expansion,  the  sharing  of  professional  services  and  facilities,  and  the 
establishment  of  area-wide  coordinating/planning  agencies  to  assist  hospitals  in 
developing  cooperative  relationships.  The  act  provided  that  receipt  of  federal 
monies  for  hospital  construction  would  be  tied  to  community  need  as  determined 
by  state  or  local  Hill-Harris  planning  agencies.  As  a  result,  the  influence  of 
Hill-Harris  has  been  a  positive  one  over  the  last  two  and  a  half  decades,  resulting 
in  new  facihties  in  priority  areas,  a  closing  of  the  gap  in  faciUties  between  rural 
and  urban  areas,  and  the  development  of  architectural,  construction,  and 
equipment  standards.  Its  principal  weakness  is  that  it  applies  only  to  surveillance 
of  hospitals  that  apply  for  federal  construction  grants,  so  that  approximately  60 
percent  of  hospital  construction  does  not  come  under  its  jurisdiction. 

Public  Law  89-749,  the  Partnership  for  Health  Act  enacted  in  1966,  is  the 
enabling  legislation  for  Comprehensive  Health  Planning  Agencies.  With  this 
legislation,  the  federal  government  recognized  the  nation's  need  for  comprehen- 
sive health  planning,  not  just  planning  of  hospital  construction.  Stronger  support 
must  be  given  to  CHP  agencies,  however,  before  they  can  begin  to  have  a 
significant  effect  on  the  health  care  system  via  the  planning  process. 

While  the  current  impact  of  areawide  planning  on  cost  control  in  health  care 
is  limited,  there  do  exist  models  of  public  regulation  that  will  be  able  to  exert  a 
stronger  influence  on  costs.  One  such  model  has  been  proposed  by  the  Barr 
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Report.  Every  health  institution  would  be  required  to  prepare  and  submit  an 
annual  institutional  plan  to  an  area-wide  planning  agency  which  would  be 
responsible  for  coordinating  all  plans,  developing  a  master  plan,  and  developing 
guidelines  for  determining  the  area's  needs.  A  statewide  agency  would  in  turn 
review  all  area  master  plans  and  submit  a  statewide  plan  of  action  to  be  reviewed 
by  federal  authorities.  Federal  financing  of  statewide  health  facilities  planning 
would  be  tied  to  federal  acceptance  of  the  statewide  plan,  so  that  control  of 
construction  would  be  essentially  based  on  federal  and  state  decision-making.  The 
apparent  assumption  with  this  model  is  that  if  a  health  institution  refused  to 
follow  the  statewide  plan  and  thus  jeopardized  a  state's  planning  finances,  the 
state  would  retahate  with  appropriate  sanctions  or  pressure  on  the  institution  to 
comply. 

A  less  centralized  model  of  cost  control  via  public  regulation  involves  third 
party  reimbursement.  Currently,  third  party  reimbursement  to  hospitals  includes 
provisions  for  capital  costs,  depreciation,  and  often  a  miscellaneous  plus  factor  to 
provide  replacement  or  expansion  capabiUties.  Thus  third  party  reimbursement 
plays  a  major  role  in  providing  funds  for  facihty  expansion.  This  role  can  be 
expounded  by  tieing  the  third  parties  to  the  planning  process.  Two  possibilities 
are  discussed  below. 

One  idea  is  to  lump  together  all  funds  that  would  have  been  reimbursed  to 
all  hospitals  for  capital  costs,  depreciation,  and  the  plus  factor,  and  set  them  aside 
for  administration  and  distribution  by  the  areawide  planning  body  according  to 
an  approved  expansion  plan.  This  idea  sees  to  it  that  the  system  as  a  whole  is  not 
deprived  of  expansion  funds  while  at  the  same  time  allocating  these  funds  in  a 
more  appropriate  manner.  The  other  idea  is  to  Unk  third  parties  with  planning  in  a 
punitive  way.  For  example,  hospitals  that  expand  without  the  approval  of  the 
planning  authority  could  have  their  reimbursement  reduced  by  the  amount  the 
expansion  adds  to  the  hospital's  costs.  Such  a  method  of  cost  control  is  currently 
in  use  in  New  Jersey  Blue  Cross  contracts.  An  alternative  punitive  measure  might 
be  cancellation  of  the  Blue  Cross  contracts  if  the  hospital  expanded  despite  a 
planning  agency  veto.  In  any  event,  the  insurance  carrier-planning  authority 
model  of  cost  control  appears  to  be  a  significant  way  of  implementing  the  cost 
controlling  abilities  of  areawide  planning. 

The  idea  of  public  regulation  of  hospital  plans  ultimately  revolves  around  the 
fact  that  hospitals  cannot  be  allowed  to  be  institutions  unto  themselves.  Actions 
that  might  be  considered  appropriate  public  regulatory  actions  include  closing 
facilities,  converting  facilities  to  another  type  of  use,  requiring  certain  services  to 
be  shared,  and  coordinating  services  to  reduce  overlap.  All  of  these  types  of 
actions  control  costs  via  system  efficiency  and  delivery  of  the  appropriate  level  of 
care;  at  the  same  time,  they  cannot  be  reached  by  hospitals  acting  unilaterally, 
nor  should  they  be  expected  of  hospitals  acting  as  a  group.  The  only  answer  may 

170 


Arthur  D  Littler  Inc 


be  some  form  of  public  regulation.  It  should  be  pointed  out,  however,  that  public 
regulation  does  not  mean  letting  hospitals  make  errors  and  then  pouncing  on 
them  when  it  is  too  late.  Public  regulation  can  also  mean  provision  of  technical 
assistance  in  any  of  a  number  of  areas,  including  management,  finance,  manpower 
utilization,  productivity,  accounting,  automation,  etc.  in  an  effort  to  help 
hospitals  reach  workable  plans  in  a  positive  way.  Regulation  ought  not  to  be  an 
omniscient  planning  agency  working  in  a  communicative  vacuum. 

B.  INSURANCE  RATE  REGULATION 

This  method  of  cost  control  can  best  be  used  to  force  providers,  third 
parties,  and  the  pubhc  to  think  about  cost  control  and  perhaps  implement 
stronger  cost  containment  methods.  Insurance  rate  regulation  cannot  succeed  as  a 
direct  form  of  cost  control,  however,  since  if  applied  too  strictly  it  must  either 
result  in  the  third  parties'  losing  money  or  the  reduction  of  benefit  coverage  for 
subscribers,  either  of  which  will  be  tolerated  for  very  long.  Its  chief  asset  is 
publicity  and  subsequent  actions  taken  and  discussions  held  by  providers,  the 
public,  and  the  insurance  carriers.  As  an  example  of  the  catalytic  abiUty  of 
insurance  rate  regulation,  one  has  only  to  look  at  the  recent  actions  of  the 
Insurance  Commissioners  in  Pennsylvania  and  in  Massachusetts. 

V.  COST  CONTROL  VIA  DELIVERY  SYSTEM  CHANGES 

A.  GROUP  PRACTICE  PREPAYMENT  PLANS 

Despite  the  many  cost  control  techniques  available  within  today's  health 
care  delivery  system,  the  fact  of  continually  rising  health  care  costs  has  prompted 
many  people  to  call  for  changes  in  the  delivery  system  itself  in  an  effort  to 
control  costs  (51,  78,  99,  127).  The  favorable  cost  and  utilization  experiences  of 
group  practice  prepayment  plans  have  forced  the  government  and  the  public  to 
look  carefully  at  this  method  of  health  care  delivery.  Despite  the  fact  that 
currently  only  six  to  seven  percent  of  the  population  receive  health  care  via 
prepaid  group  practice,  many  health  professionals  feel  that  this  system  may  well 
be  the  wave  of  the  future.  Pending  federal  legislation  supports  the  essentials  of 
prepaid  group  practice  in  its  definitions  of  Health  Maintenance  Organizations,  and 
while  it  is  true  that  an  HMO  may  take  several  forms,  the  essence  of  prepaid  group 
practice  remains  in  all  of  these  forms:  delivery  of  a  comprehensive  range  of 
inpatient  and  outpatient  services  financed  on  a  capitation  basis  (single  annual  fee 
per  patient  regardless  of  utilization).  By  tieing  the  health  care  delivery  system  to 
the  health  care  financing  system  by  the  capitation  method  of  payment,  significant 
changes  from  the  present  delivery  system  are  made;  physicians  become  involved  in 
risk-bearing,  and  new  motivations  for  responsible  cost  control  arise.  While  costs 
may  rise  from  year  to  year,  the  key  point  is  that  due  to  capitation,  the  prepaid 
plan  must  absorb  all  losses  if  costs  are  higher  than  planned,  and  can  share  the 
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savings  with  physician  members  if  payments  exceed  costs.  The  physician  is  thus 
under  continual  pressure  to  evaluate  the  appropriateness  of  the  medical  care  he 
delivers.  In  addition,  due  to  the  group  nature  of  the  group  practice  plan,  there  are 
many  build-in  cost  savings  due  to  centralization  of  facihties,  administration,  EDP, 
medical  records,  laboratories,  accounting,  ancillary  personnel,  etc. 

Empirical  evidence  based  on  the  past  experiences  of  group  practice 
pre-payment  plans  is  the  best  testimony  to  their  cost  control  effectiveness.  As 
previously  discussed,  control  of  utilization  of  health  services  is  perhaps  the 
fundamental  key  to  cost  control.  In  this  regard,  group  practice  pre-payment  plans 
have  shown  significant  savings  in  inpatient  hospital  utilization  and  surgery.  While 
many  studies  have  shown  the  marked  differences  in  all  hospital  utilization 
parameters  between  group  practice  pre-payment  and  the  traditional  delivery 
system,  perhaps  the  most  widely  quoted  is  George  Perrott's  study  of  FEHBPUS  in 
the  early  1960's.  In  this  study,  Perrott  showed  that  for  federal  employees  enrolled 
in  the  available  group  practice  pre-payment  plan,  hospital  days  per  1000  enrollees 
in  1961  —  1962  were  55.1  percent  of  the  figure  for  employees  enrolled  in  Blue 
Cross/Blue  Shield  and  64.3  percent  of  the  figure  for  employees  enrolled  under 
indemnity  plans,  with  even  more  favorable  figures  for  the  1962—1963  period. 
Similar  findings  have  been  observed  in  the  Kaiser  plan  in  California  and  other 
group  practices.  As  an  example  of  what  this  means  in  terms  of  costs,  it  is 
estimated  that  at  Kaiser,  consumer  input  in  dollars  is  65—80  percent  of  what  it 
would  be  for  comparable  services  in  a  traditional  fee-for-service  setting  (97). 
Government  interest  in  group  practice  pre-payment,  while  not  motivated  on  the 
basis  of  cost  control  alone,  is  certainly  justified  on  this  basis. 

B.  FOUNDATIONS  FOR  MEDICAL  CARE 

While  references  to  the  Foundations  for  Medical  Care  have  been  in  the  claims 
review  section  of  this  paper,  their  peer/claims  review  function  is  not  the  only 
function  they  may  serve  (146).  The  Foundations  have  recently  begun  to 
experiment  with  delivery  of  health  services  on  a  contractual,  capitation  basis  (36). 
The  San  Joaquin  Foundation-Medicaid  program  is  an  excellent  example  of  this 
model  of  health  care  delivery.  The  Foundation  has  contracted  with  the  state  to 
serve  Medicaid  patients  on  a  capitation  basis,  with  physicians  being  reimbursed  on 
a  fee-for-service  basis.  The  Foundation  receives  an  annual  fee  for  each  Medicaid 
patient,  and  is  responsible  for  distributing  the  funds  to  Foundation  physicians 
who  render  services  to  these  patients.  The  Foundation  has  assumed  risk  in  this 
model,  since  services  must  be  delivered  under  the  contract  even  if  funds  have 
expired;  thus  the  essence  of  an  HMO  is  found  here  even  though  fee-for-service 
reimbursement  is  used. 
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The  experience  of  this  model  over  the  first  three  years  of  operation  is  quite 
enlightening.  In  the  first  year,  the  physicians  were  paid  the  usual,  customary,  and 
reasonable  fees  for  their  services  (more  than  other  Cahfomia  Medicaid  physicians 
were  receiving)  and  returned  the  excess  of  receipts  over  disbursements  to  the  state 
at  the  end  of  the  fiscal  year.  In  the  second  year,  funds  ran  out  in  the  last  month 
and  fees  over  the  last  month  were  pro-rated  as  a  result.  The  third  year  showed  a 
surplus  of  funds,  which  this  time  was  kept  by  the  Foundation  to  be  used  as  a 
reserve  against  future  losses. 

One  of  the  key  problems  of  this  model  is  the  idea  of  fee-for-service 
reimbursement.  Due  to  this  method  of  reimbursement,  physicians  are  given  an 
incentive  toward  overutilization;  the  more  services  delivered,  the  more  fees  paid, 
and  with  a  fixed  total  sum  to  be  paid  out,  competition  for  the  available  funds 
dictates  over-delivery  of  services.  Where  the  Foundations  have  a  unique  solution 
to  this  problem  is  in  their  peer  review  mechanism.  If  they  can  enforce  appropriate 
standards  of  over-  and  under-utilization,  then  competition  for  the  capitation 
funds  can  be  eliminated,  and  the  model  may  work  well. 

Conclusions  that  this  type  of  HMO  model  using  fee-for-service  reimburse- 
ment is  a  viable  one  should  not  be  drawn  hastily.  The  real  savings  in  the  prepaid 
group  practice  HMO  model  are  in  control  over  hospital  utilization.  If  the 
Foundation  model  can  incorporate  pre-payment  for  hospital  care  and  success- 
fully apply  CHAP  (which  has  begun  to  show  utilization  figures  comparable  to 
Kaiser)  to  reduce  hospital  utilization,  then  the  substantial  differences  between  the 
two  models  as  cost  control  mechanisms  are  rather  small.  As  long  as  the  incentive 
and  ability  to  control  hospital  utilization  is  present,  the  Foundation  model  can 
work  well.  If  not,  then  the  Foundation  model  is  a  poor  second  as  a  cost  control 
mechanism. 
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QUALITY  OF  CARE  ASSESSMENT 


by  Suzanne  H.  Kase,  R.N. 

INTRODUCTION 

Donabedian  (48)  divides  quality  of  care  appraisal  methods  into  two  major 
classifications;  (1)  appraisal  of  process  and  (2)  appraisal  of  outcome.  Included  in 
the  subdivision  of  process  appraisal  methodology  are  (1)  case  review  and  (2)  data 
used  for  clinical  decision-making.  In  this  sense,  process  appraisal  refers  to  the 
evaluation  of  the  activities  of  physicians  and  other  health  professionals  in  the 
management  of  patients. 

Process  appraisal  may  be  defined  as  that  which  a  provider  does  to  a  patient 
which  is  then  observed/measured  against  some  yardstick  which  leads  to  a  decision 
of  good  or  bad  and  if  bad,  allows  alternative  courses  of  action  to  correct  the 
"badness."  The  underlying  assumption  is  that  the  criteria  are  used  to  imply 
quality  and  are  based  upon  previously  established  and  accepted  standards  or 
norms. 

Given  that  evaluation  of  process  is  the  basis  for  judgment  concerning  quality, 
there  is  a  major  assumption  that  health  care  is  useful  in  maintaining  or  promoting 
health.  Furthermore,  there  is  an  assumption  that  particular  elements  and  aspects 
of  care  are  known  to  be  physically  related  to  successful  or  unsuccessful  health 
outcomes  or  end  results. 

DeGeyndt  (40)  further  delineates  quality  of  care  evaluation  into  two  areas: 

•  Assessment  of  content  answers  the  basic  question  of  how  medical  care 
is  practiced  or  of  the  content  of  clinical  performance.  Most  quahty  of 
care  studies  have  focused  on  the  content  of  care. 

•  Assessment  of  process  emphasizes  the  technical  aspects  of  quahty  of 
care.  In  addition,  it  addresses  the  concept  of  the  "whole  patient", 
evaluating  not  only  the  work  of  the  physician,  but  also  the  contribu- 
tions of  other  health  workers.  Total  management  of  the  patient 
encompasses  the  prevention  of  illness,  the  arrest  of  pathological 
processes  and  physical  rehabiHtation.  Patterns  of  referral  and  consulta- 
tion with  other  health  professionals  are  taken  into  consideration  and 
are  comprehensive  in  nature,  i.e.,  more  complete  and  continuous,  and 
less  episodic  and  fragmented.  The  development  of  measurement 
instruments  to  express  the  interrelationships  between  the  dynamic 
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elements  of  the  care  process  and  the  interactions  of  the  participants, 
represents  a  major  difficulty.  An  important  assumption  underlying  the 
rationale  of  this  approach  is  that  coordination  of  team  work  and  a 
logical  sequence  of  various  elements  in  the  care  process  will  result  in 
improved  health  status  of  the  recipients. 

DEFINITION  OF  QUALITY  OF  CARE 

A  number  of  authors,  such  as  Payne  (142),  Esselstyne  in  Donabedian  (48), 
and  Lee  and  Jones  (112),  have  addressed  the  problem  of  defining  quality  of  care. 
These  definitions  encompass  a  spectrum  of  ideas  from  the  technical  aspects  of 
practice  (142),  documentation  (48,142),  outcome  concerns  (142),  physician- 
patient  relationships  (112),  range  of  services  (112),  and  accessibility  and 
availabUity  (48,112). 

Donabedian  (48)  states  that  "quality  of  medical  care  is  extraordinarily 
difficult  to  define  since  one  must  first  indicate  what  dimensions  or  aspects  of  care 
are  subject  to  consideration  and  then  specify  what  constitutes  'goodness'  or 
'badness'  with  respect  to  these  aspects  or  dimensions." 

Payne's  (142)  definition  includes  process  and  outcome  relationships.  He 
states  "quality  is  that  level  of  excellence  produced  and  documented  in  the  process 
of  diagnosis  and  therapy,  based  on  the  best  knowledge  derived  from  science  and 
the  humanities  which  eventuates  in  the  least  morbidity  and  mortality  among  the 
population."  Esselstyne  (48)  directs  attention  toward  standards  of  quality  which 
include  availability  of  care  as  well  as  documentation  and  the  extent  to  which 
adequate  therapy  is  based  on  accurate  diagnosis.  In  defining  quality  of  care,  Lee 
and  Jones  have  expanded  their  definition  to  include  "the  manner  in  which  the 
total  capabilities  of  the  medical  care  system  are  deployed  in  the  interests  of  all  the 
people." 

DeGuyndt  (40)  defines  quahty  as  the  degree  of  conformity  with  preset 
standards  and  deals  almost  exclusively  with  patient  care  as  contrasted  to  medical 
care  and  health  care.  Assessment  of  the  content  of  clinical  performance  depends 
upon  the  development  of  standards  which  in  turn  depends  upon  professional 
judgment  and  consensus  on  the  nature  of  good  care.  He  further  states  that  to 
define  quality  is  to  limit  its  meaning,  that  the  definition  reflects  the  value 
judgment  on  the  part  of  its  author  and  that  the  definition  implicitly  advocates  the 
criteria  to  be  used  in  quality  of  care. 

Weed  (199)  states  that  quality  control  can  be  thought  of  on  two  levels  of 
sophistication.  One  level  attempts  to  identify  glaring  errors  while  the  other 
reflects,  unequivocally,  the  understanding  that  quality  is  the  excellence  with 
which  a  well  defined  function  is  fulfilled. 
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Weed  further  believes  that  evaluation  of  quality  is  based  on : 

(1)  Agreement,  before  hand,  on  a  data  base  and  how  it  should  be  recorded. 

(2)  Agreement,  before  hand,  as  to  what  care  patients  should  receive. 

(3)  Careful  formulation  of  problems. 

(4)  Unambiguous  data  as  to  what  was  done  for  each  problem. 

(5)  How  each  problem  was  solved. 
AUDIT 

Donabedian  (48)  states  that  case  review  is  a  detailed  examination  of 
professional  performance  for  appraisal  of  quality  and  the  use  of  service  and  is  the 
most  definitive  of  all  methods  of  assessment.  These  reviews  or  audits  may  be 
described  as: 

•  External  audit  carried  out  by  one  or  more  examiners  who  are 
independent  of  the  hospital  or  other  setting  in  which  the  care  is 
delivered,  and 

•  Internal  audit  conducted  by  one  or  more  committees  of  the  medical 
staff  in  the  setting  in  which  the  care  is  delivered. 

Ferrier  (64)  in  "Appraising  and  Improving  the  Quality  of  Medical  Care  in 
Ambulatory  Group  Practice"  reports  experience  with  internal  and  external  audits. 
Two  of  the  external  audits  focused  primarily  on  attempting  to  measure  the  extent 
to  which  the  programs  of  the  clinic  approached  the  ideal  model  of  comprehensive 
prepayment  group  practice.  The  third  external  audit  compared  the  types  and 
volume  of  services  in  three  chnics  with  the  performances  of  the  outpatient 
teaching  facility  of  the  University  of  Pittsburgh  School  of  Medicine.  It  was  found 
that  external  audits  stimulated  the  performance  of  internal  audits  in  all  the 
clinics. 

An  extensive  internal  audit  was  carried  out  in  one  clinic  utilizing  worksheets 
constructed  to  aadress  not  only  the  technological  dimensions  of  care,  but  also  the 
important  elements  of  continuity  and  coordination.  The  primary  purpose  of  this 
audit  was  to  provide  a  critical  appraisal  of  the  quality  of  medical  services  provided 
by  the  medical  group  and  was  directed  to  an  elucidation  of  problems  and 
weaknesses  common  to  the  group  rather  than  to  an  estimation  of  the  errors  of  an 
individual  physician. 
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STANDARDS  AND  CRITERIA 


The  development  of  standards  and/or  criteria  for  comparison  of  actual 
practice  with  desirable  practice  remains  the  focal  point  for  issues  of  process 
assessment. 

Donabedian  (48)  states  that  standards  are  the  essential  ingredient  of  any 
system  of  measurement  or  appraisal.  He  addresses  the  following  nine  aspects  of 
standards: 

•  Source  —  standards  may  be  derived  from  two  sources; 

1)  Those  based  upon  expert  opinion,  notions,  or  pronouncements  of 
what  is  good  (normative  standards).  These  may  be  formulated  by 
recognized  leaders  in  their  respective  specialties,  expert  panels 
from  medical  schools,  research  staffs,  qualified  practitioners, 
textbooks  and  standard  publications.  However,  he  points  out  that 
these  standards  also  may  be  set  by  lesser  experts  or  by  those  values 
held  generally  by  the  rank-and-file  of  medical  practice. 

2)  Empirical  standards  —  are  derived  from  actual  practice  patterns  of 
physicians  including  those  associated  with  outstanding  teaching 
hospitals  and  medical  schools.  Usually,  these  standards  are  derived 
from  practice  in  the  general  community. 

•  Validity  —  validation  of  standards  is  ultimately  derived  from  their 
demonstrated  relationships  to  valued  outcomes.  Comparative  studies  of 
actual  practice  provide  tests  of  validity,  e.g.  changes  in  length  of  stay, 
when  based  on  observations  that  length  of  stay  in  some  hospitals  has 
been  reduced  without  apparent  adverse  effect  on  the  patient. 

•  Consensus  —  a  certain  degree  of  agreement  among  recognized  leaders  in 
the  profession  is  necessary  to  permit  convincing  evaluation.  In  some 
instances,  if  consensus  cannot  be  reached  two  standards  may  have  to  be 
developed,  e.g.  the  question  of  indications  for  tonsillectomy. 

•  Stability  —  standards,  especially  those  that  are  normatively  derived, 
need  to  be  constantly  reformulated  as  medical  science  and  technology 
change. 

•  Transferability  -  this  refers  to  the  applicability  of  standards  to  all 
groups  and  settings.  This  is  pertinent  in  relationship  to  standards  set  for 
general  practice  and  those  for  specialists  in  academic  settings.  Some  feel 
that  normative  standards  for  good  practice,  if  they  represent  what 
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current  medical  science  can  achieve,  should  be  of  general  applicability. 
Different  characteristics  may  be  found  in  various  localities.  As  an 
example,  the  availabihty  and  provisions  for  alternatives  to  hospitaliza- 
tion may  influence  length  of  stay  standards,  e.g.  presence  or  absence  of 
home  care  services. 

•  Configuration  —  there  are  two  characteristics  to  which  this  aspect 
applies.  Monotonia  establishes  the  degree  of  attainment  of  the  goal 
under  the  best  conditions  of  care.  This  is  described  as  "the  more,  the 
better"  or  "the  less,  the  better".  For  example,  it  may  be  that  100 
percent  of  cases  of  diagnosed  myocardial  infarction  should  have  had  an 
electrocardiogram  in  the  process  of  investigation. 

•  Inflected  —  configuration  refers  to  an  optimum  range  or  value  in  which 
the  quality  decreases  above  or  below.  Donabedian  cites  an  example 
from  Slee  who  suggests  that  the  optimal  range  for  a  pathologically 
positive  tissue  in  primary  appendectomy  may  be  80  percent  to  90 
percent.  A  percentage  lower  may  mean  too  great  a  readiness  to  operate; 
a  higher  percentage  may  mean  excessive  conservatism  and  the  possibil- 
ity that  the  inflamed  appendices  are  allowed  to  go  untreated.  Inflected 
configuration  should  be  determined  empirically  and  cannot  be  stated 
a  priori 

•  Level  of  stringency  —  Normative  and  empirical  standards  can  be  set  at 
various  levels.  Levels  of  stringency  should  be  set  to  allow  the  ability  to 
discriminate  while  at  the  same  time  not  setting  standards  so  high  that 
no  practice  in  real  hfe  can  meet  it.  A  second  consideration  is  the  yield 
of  the  standard  or  the  volume  of  aberrant  cases  identified  in 
relationship  to  the  effort  expended  in  reviewing  the  cases. 

•  Content  —  it  becomes  important  to  examine  what  dimensions  of  care 
will  be  used  to  determine  the  quality  of  the  care.  Poly  dimensional 
refers  to  those  in  which  a  broad  number  of  dimensions  of  care  are 
examined.  These  may  include  the  records,  the  diagnostic  management, 
and  the  treatment  and  follow-up;  each  of  these  sections  having  four  or 
five  parts.  Oligodimensional  studies  are  those  in  which  two  or  three 
items  are  chosen  to  represent  the  complex  concept  of  quahty. 
Donabedian  (48)  refers  to  the  studies  of  Peterson  and  Barsamian 
(148,  150)  which  concentrate  on  two  basic  dimensions:  justification  of 
diagnosis  and  therapy.  Most  of  the  studies  which  have  been  examined 
are  those  which  have  developed  criteria  relevant  to  the  traditionally 
defined  dimensions  of  technical  management.  Seldom  included  in  the 
content  of  studies  are  those  aspects  which  deal  with  preventive, 
rehabilitative,  social,  and  psychological  management.  One  of  the  factors 
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which  influences  the  completeness  of  content  assessment  is  dependent 
upon  the  extent  of  homogeneity  within  the  practice  of  the  physician  or 
institution.  It  may  be  that  the  more  homogeneous  the  practice,  only  a 
few  aspects  of  care  may  need  to  be  examined  to  give  a  reasonably  good 
picture  of  the  quality  of  care. 

Donabedian  (48)  pays  particular  attention  to  the  relationship  of  the 
number  and  nature  of  dimensions  represented  in  the  standards  to  the 
abiUty  of  the  standard  to  discriminate  among  levels  of  care.  Morehead 
(128)  describes  this  problem  in  that  a  patient  may  have  had  good  or 
excellent  care  in  relationship  to  the  technical  portion  of  his  care 
whereas  another  patient  may  have  had  not  only  that,  but  also  attention 
to  some  of  his  social,  psychological,  etc.  needs.  This  indicates  that  there 
may  be  a  hierarchical  order  in  physician  performance  with  respect  to 
the  many  dimensions  of  care. 

It  is  important,  therefore,  to  identify  what  dimensions  are  included  in 
the  evaluational  system  and  to  judge  whether  they  cover  the  range  of 
dimensions  believed  necessary  to  obtain  a  well-rounded  view  of  quality. 

•  Explicitness  —  Donabedian  (48)  states  that  specification  of  criteria 
indicates  the  degree  to  which  the  standards  and  procedures  for 
evaluation  have  been  formalized.  Implicit  criteria  —  indicate  that  the 
examiner  is  the  expert,  and  that  he  compares  and  judges  the 
management  of  the  case  as  though  it  were  his  own.  Explicit  criteria  —  is 
characterized  by  prior,  explicit  and  formal  specification  of  criteria  and 
procedures  to  be  used  in  the  evaluation.  Professional  judgment  is  used, 
but  hmited  by  instruction  as  to  what  aspects  are  to  be  considered. 

deRouville's  (45)  study  of  peer  review  in  biliary  tract  surgery  concluded 
that  a  review  mechanism  which  relies  on  pure  peer  judgment  by 
multiple  assessors  is  not  a  satisfactory  tool  for  measuring  the  quality  of 
medical  care  within  a  large  population  of  cases.  Tliis  is  apart  from  the 
obvious  disadvantages  of  excessive  costs,  expenditure  of  huge  amounts 
of  professional  time,  and  lack  of  sufficient  numbers  of  reviewers  willing 
to  participate.  A  comprehensive  evaluation  form  was  prepared  for 
reviewer  use,  furnishing  no  criteria  or  standards.  Reviewers  were  forced 
to  rely  entirely  on  their  own  judgment  in  rendering  a  final  evaluation  of 
the  quality  of  care  rendered.  The  reviewer  was  required  to  report  two 
final  judgments:  1)  judgment  on  a  five-point  scale,  from  superior  to 
totally  unacceptable;  and  2)  judgment  on  a  scale  of  only  two  categories; 
satisfactory  and  unsatisfactory.  Changes  in  leniency  were  observed  and 
documented  by  reviewers  during  the  course  of  this  study. 
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A  second  group  of  cases  were  reviewed  in  which  an  evaluation  form  was 
developed.  It  contained  a  number  of  built-in  criteria  for  use  with 
guidelines  by  the  reviewer  and  included  instructions  for  determining  the 
level  of  quahty  and  certain  defined  standards  of  clinical  investigation.  It 
required  a  large  element  of  subjective  judgment  in  reaching  the  final 
decision  of  satisfactory  or  unsatisfactory.  The  application  of  even  the 
moderately  flexible  built-in  criteria  increased  the  frequency  with  which 
more  stringent  judgments  were  made. 

Length-of-stay  norms  developed  by  PAS  are  an  example  of  empiric 
criteria.  Lengths  of  stay  by  diagnosis  are  reported  both  on  national  and 
regional  bases  and  are  representative  of  the  current,  on-going,  practice. 
The  use  of  these  data  in  estabUshing  criteria  is  demonstrated  by  the 
Experimental  Medical  Care  Review  Organization  in  Mississippi  in  which 
the  PAS  data  were  used  in  establishing  LOS  criteria  for  specific 
diagnoses.  As  data  were  collected  and  compared  to  actual  practice  in 
Mississippi,  these  length  of  stay  criteria  were  modified  to  match  the 
practice  in  the  area. 

Fessel  (65)  in  a  study  assessing  quality  of  care  from  medical  records 
developed  a  methodology  to  determine  the  extent  to  which  the 
quantity  or  quality  of  recorded  data  was  related  to  the  outcome  of 
either  acute  appendicitis  or  myocardial  infarction.  In  this  study,  both 
normative  and  empiric  criteria  were  used.  The  empiric  criteria  listed  44 
items  which  had  been  documented  for  75  percent  or  more  of  the 
patients  from  50  randomly  selected  patients  with  acute  myocardial 
infarction.  Further  on  in  the  study,  Fessel's  group  requested  three 
cardiologists  to  compile  a  traditional  audit  list  for  acute  myocardial 
infarction;  the  cardiologists  considered  the  items  they  listed  to  be  mini- 
mal requirements  for  a  good  quality  medical  care  of  this  disorder. 

Schonfeld  (179)  undertook  study  to  provide  information  that  could  be 
used  in  describing  the  content  of  good  dental  care  and  in  developing 
standards  that  could  be  appHed  to  clinical  audits  of  dental  practice.  The 
dimensions  defined  were:  the  types  of  dental  services  that  should  be 
provided,  the  sequence  in  which  they  should  be  given,  the  factors  that 
interfere  with  the  provision  and  receipt  of  needed  dental  care,  and  the 
health  consequences  of  not  receiving  the  needed  services.  Emphasis  in 
the  study  was  in  the  methodology  used  to  develop  indices  by  which  the 
content  of  good  dental  practice  could  be  measured.  Normative  criteria 
were  developed  from  the  professional  judgments  of  quaUfied  dental 
practitioners  with  the  view  towards  utilizing  general  dental  practitioners 
as  well  as  dental  speciaHsts  in  various  locations  to  ultimately  provide 
representation  from  various  organizational  patterns,  e.g.,  solo  private 
practice,  partnerships,  private  and  public  group  practice  teams,  etc. 

180 


Arthur  D  Little,  Inc. 


The  standards  being  developed  by  the  previous  group  of  dentists  were 
then  submitted  for  review  to  the  larger  groups  of  dentists  including 
dental  school  faculty  members,  pubhc  health  and  other  medical 
personnel  and  representatives  of  organized  consumer  groups.  The 
indices  or  dimensions  of  care  developed  through  this  approach  extend 
to  prevention,  examination,  treatment,  and  treatment  planning  for 
various  categories  of  patients  and  conditions  with  dental  problems. 
Many  of  the  standards  for  these  indices  will  be  presented  either  for  all 
people  having  the  disease  or  condition  or  will  be  limited  to  a  specified 
dentition,  such  as  prior  examination  or  treatment  group.  The  informa- 
tion contained  in  the  various  sections  of  the  completed  interview 
schedules  allows  the  data  utihzed  to  describe  the  content  of  good 
dental  care.  The  opinions  of  several  dentists  interviewed  on  the  same 
subject  are  being  consohdated.  When  substantive  agreement  exists,  the 
quantitative  data  are  combined  and  expressed  in  the  form  of  distribu- 
tion of  values  and/or  as  summary  statistics.  If  there  is  no  substantial 
agreement  among  the  respondents,  more  than  one  value  is  being 
prepared  for  the  index. 

Lembcke  describes  analysis  as  being  objective  or  subjective  in  methodology 
and  refers  to  case-by-case  analyses  with  partly  objective  and  partly  subjective 
methods  which  have  been  conducted  by  a  few  independent  medical  auditors  — 
Eisele,  Rosenfeld,  Trussel,  Makover,  etc.  —  on  a  small  scale.  The  subjective 
method  refers  to  the  value  judgments  made  by  the  reviewer  by  applying  expert 
personal  knowledge  to  the  evaluation  of  individual  cases.  These  findings  can  be 
expressed  in  objective  terms  such  as  the  incidence  of  operations.  A  central  issue  is 
the  need  for  objective  criteria  and  for  standards  by  which  to  measure  compliance 
with  the  criteria.  Lembcke  (113)  has  described  six  cardinal  points  applicable  to  all 
criteria  as  follows: 

•  Objectivity  —  stated  in  writing  with  sufficient  precision  and  detail  to 
make  them  relatively  immune  to  varying  interpretations  by  different 
individuals. 

•  Verifiability  —  so  framed  so  that  points  on  which  they  rest  could  be 
verified  by  laboratory  examination,  consultation,  or  documentation. 

•  Uniformity  —  independent  of  such  factors  as  size  or  location  of 
hospital,  qualification  of  the  physician  or  social  and  economic  status  of 
patient. 

•  Specificity  —  specific  for  each  kind  of  disease  or  operation  to  be 
evaluated  and  all  significant  and  closely  related  diseases  or  operations  in 
the  same  patient  considered  as  a  unit. 
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•  Pertinence  —  pertinent  to  the  ultimate  aim  of  the  medical  care  being 
evaluated  and  based  on  results  rather  than  intention. 

•  Acceptability  —  conform  with  generally  accepted  levels  of  good  quality 
as  set  forth  in  leading  textbooks  and  articles  based  on  scientific  study. 

Criteria  then  need  to  be  tested  on  sufficient  numbers  of  cases  to  assure  that 
the  data  to  which  they  apply  are  available  in  most  instances.  FeasibiUty  of 
compliance  by  the  medical  staff  is  another  major  source  of  concern.  Validation  of 
the  criteria  can  ultimately  be  accomplished  by  correlation  with  outcome  studies. 

Standards  refer  to  the  degree  or  percentage  of  compliance  with  criteria 
which  can  be  calculated  for  each  hospital  and  each  physician.  Since  perfection  is 
seldom  attainable  in  medical  practice  or  in  the  framing  of  criteria,  allowance  must 
be  made  systematically  and  objectively  to  accommodate  the  inexactness  of 
criteria  and  the  exercise  of  clinical  judgment.  Lembcke  further  states  that  really 
valuable  definitions  and  criteria  can  be  developed  only,  if  after  being  formulated, 
they  are  published  and  thus  subjected  to  criticism  and  improvement  by  others. 

In  criteria  formulation,  emphasis  should  fall  on  the  key  elements  of  technical 
management  that  can  usually  be  identified  as  present  or  absent  by  the  review  of 
the  records.  The  more  general  and  non-directive  the  standards  are,  the  more  one 
must  depend  upon  the  interpretation  and  implicit  norms  of  the  person  who  is 
doing  the  actual  assessment  of  care.  If  criteria  are  developed  in  staff  participation 
as  advocated  by  Payne,  it  insures  acceptability  of  the  criteria  and  the  whole 
system  of  quality  supervision.  This  can  be  an  important  part  of  education, 
communication,  and  change  in  behavior.  With  increased  specificity  of  criteria 
abstracting,  the  process  of  evaluation  can  be  expedited  and  with  still  greater 
specification  of  criteria  the  entire  task  can  be  turned  over  to  a  computer. 
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SOURCES  OF  INFORMATION 


In  attempting  to  describe  various  parts  of  the  review  process,  it  is  useful  to 
describe  the  sources  of  information  or  data  base  as  follows: 

•  Direct  observation  —  of  a  clinical  situation  by  a  confident  observer  is  a 
method  well  documented  by  a  classic  study  done  by  Peterson  ( 1 5 1 )  of 
North  Carolina  General  Practitioners.  In  this  work,  direct  observation 
of  the  physicians  in  actual  practice  was  made.  The  variation  and  quality 
of  the  physician's  performance  were  related,  among  others,  to 
performance  and  medical  school  length  of  internship  and  residency 
training  and  age. 

Hinz  (87)  utilizes  the  observations  of  actual  performance  of  senior 
medical  students  in  an  ambulatory  clerkship  to  describe  performance  of 
clinical  skill.  Two  areas  of  study  were  designed;  one  to  document  the 
interactions  and  communication  of  the  medical  student  toward  the 
patient  and  one  to  rate  the  content  of  information  extracted  from  the 
patient  by  the  student.  Of  particular  concern  in  the  study  was  student 
performance  in  history-taking  and  physical  examination.  Normative 
criteria  were  developed  by  a  group  of  internists  (on  the  faculty).  Under 
"content  of  present  illness,"  various  types  of  information  were  listed 
and  the  observer  rated  how  completely  these  items  were  addressed  by 
the  student.  Various  items  were  listed  under  "technique  of  eliciting 
history"  and  the  student  was  adjudged  as  to  whether  these  were  or  were 
not  done,  and  whether  they  were  appropriate  or  inappropriate. 
"Routine  history"  was  itemized  as  well  as  the  degree  to  which  these 
were  completely  addressed  by  the  student,  as  were  "physical  examina- 
tion" and  "presentation  of  the  case."  Items  on  the  hst  were  tested  for 
pertinance  to  all  or  at  least  most  patient  examinations  and  for 
observability.  Training  of  the  observers  had  to  be  done  due  to 
inter-rater  variation  in  scoring.  In  addition,  a  great  deal  of  professional 
time  was  required  with  its  subsequent  increase  costs. 

•  Interview  method  —  a  second  way  of  achieving  an  information  base  for 
attitude/opinion  surveys  is  the  interview  method.  The  Brook  and 
Stevenson  (22)  study  on  effectiveness  of  patient  care  in  the  emergency 
room  used  patient  opinion  surveys  to  determine  the  nature  of 
communication  between  the  physician  and  patient.  Although  the  study 
is  better  known  for  its  approach  to  assessing  quality  of  care  by  process 
and  outcome,  one  portion  of  this  study  utilized  information  gained 
from  the  patient  via  the  interview  technique  and  was  used  in  reference 
to  the  outcome  assessment  portion  of  the  study.  The  patients  in  this 
study  were  those  selected  by  presentation  to  the  emergency  room  with 
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non-emergency  gastro-intestinal  symptoms  and  referred  to  the  X-ray 
Department  for  further  gastro-intestinal  evaluation.  Normative  criteria 
were  established  for  an  adequate  workup.  Criteria  selected  were: 
completion  of  x-ray  studies  on  the  patient,  production  of  an  x-ray  film 
of  adequate  quality  to  eliminate  treatable  lesions  and  proctoscopy  on 
all  patients  who  received  a  barium  enema  x-ray  examination.  Each 
patient  was  contacted  by  personal  contact  or  telephone  subsequent  to 
their  interaction  with  the  emergency  room  to  determine  the  followup 
for  appropriate  therapy. 

The  difficulty  of  the  observation  and  interview  methods  of  data 
collection  he  with  the  excessive  cost  of  providing  observer/ recorders; 
whether  they  be  professionals  or  non-professionals  as  well  as  the 
cumbersome  management  of  data;  complexity  of  the  process;  and 
subsequent  problems  with  bias,  validity,  and  reliability.  However,  data 
collection  for  examining  the  dynamics  of  an  interactive  process  seem  to 
rest  on  observer-recorder  methodology. 

•  Clinical  records  —  the  third  and  most  widely  used  method  of  developing 
a  data  base  is  the  utilization  of  data  abstracted  from  medical  records, 
with  or  without  subsequent  coding  of  these  data  for  further  use  by  the 
reviewer.  This  provides  tangible  evidence  in  an  accessible  form  of  the 
kinds  of  care  given.  These  documents  also  provide  the  source  material 
for  most  studies  of  the  medical  care  process  and  are  the  basis  for  case 
review  and  for  assistance  of  statistical  display  and  analysis.  Records  of 
this  type  have  been  restricted  to  the  assessment  of  care  in  hospitals, 
outpatient  departments  of  hospitals  and  pre-paid  group  practice.  Office 
records  of  physicians  have  not  been  widely  used  since  they  are 
notoriously  incomplete,  inadequate,  and  inaccessible.  The  adequacy  of 
records  as  a  basis  for  assessment  poses  several  problems:  1)  was  care 
actually  provided,  and  2)  was  care  imperfectly  reflected  in  the  written 
record. 

Factors  which  may  influence  the  decision  as  to  whether  care  was 
actually  provided  can  be  performance  of  tests  or  treatments  prior  to 
hospital  admission,  inadequate  recording,  or  inadequate  care.  If  it  is 
imperfectly  reflected  in  the  written  record,  this  can  be  due  to  a 
problem  of  completeness  or  one  of  veracity.  Veracity  may  be  due  to 
inaccurate  recording  of  events,  or  errors  in  data  used  to  develop  the 
diagnosis  of  plans,  such  as  incorrect  laboratory  results. 

Rudy  (171)  in  "The  Effect  of  Quality  Control  on  Inter-Laboratory 
Performance"  addresses  the  need  for  quahty  control  in  the  clinical  laboratory.  In 
this  study,  four  laboratories  servicing  hospitals  and  one  servicing  a  physician's 
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referral  service  were  studied.  None  of  these  laboratories  were  using  consistent 
quality  control  programs.  For  seven  months,  serum  samples  reflecting  high, 
normal  and  low  physiologic  values  were  distributed  to  these  laboratories  for 
sodium,  potassium,  and  calcium  analyses.  Following  recahbration  of  instruments 
and  required  repairs,  quality  control  programs  were  initiated  and  additional  serum 
samples  were  analyzed.  The  results  were  collected  and  statistics  calculated  to 
determine  improvement,  if  any,  in  accuracy  and  provision.  This  study  showed 
that  quaUty  control  alone  will  not  provide  improvement  in  results.  However,  it 
does  provide  the  information  necessary  to  achieve  improved  accuracy  and 
provision.  If  the  information  is  used  correctly,  it  will  also  provide  the  first 
indication  that  results  have  begun  to  deteriorate  in  quality. 

Another  area  of  concern  is  that  of  the  impact  of  bias  by  the  reviewer.  Helbig 
(84)  in  his  study,  "The  Care  Component  Score  —  A  New  System  for  Evaluating 
Quality  of  Inpatient  Care,"  addresses  this  issue.  In  this  study  14  components  of 
in-hospital  care  were  selected  as  means  of  aggregating  the  impressions  of  reviewing 
physicians  into  a  composite  score.  The  reviewing  physicians  who  participated  had 
for  the  most  part  extensive  experience  in  reviewing  case  summaries  in  hospitals 
prior  to  the  trial. 

A  potential  bias  in  the  study  was  that  the  reviewer  might  rate  the  individual 
cases  according  to  his  prior  impression  of  the  hospital  where  care  was  given.  In 
order  to  test  the  hypothesis  that  knowledge  of  hospital  identity  may  be  an 
important  biasing  factor,  a  random  sampling  was  made  consisting  of  50  cases  a 
year  rated  previously  by  one  of  the  reviewers.  These  case  summaries  were  retyped 
without  reference  to  hospital  identity  and  resubmitted  to  the  same  reviewer. 
Detailed  analysis  indicated  that  bias  was  operative  but  not  seriously  so.  To  avoid 
this  risk  of  bias,  the  revised  care  component  score  system  would  insure  that 
reviewing  physicians  not  be  aware  of  the  hospital  identity  while  reviewing  case 
summaries. 

Clinical  chart  review  lends  itself  more  readily  to  examining  the  dimensions  of 
a  technical  quality  of  care.  However,  it  has  proven  much  more  difficult  to  record 
and  identify  data  on  the  social  and  psychological  management  of  the  patient, 
since  these  areas  of  patient  care  are  not  generally  recorded  on  the  patient's  record. 

The  content  and  format  of  the  inpatient  record  have  long  been  controlled 
and  regularized  by  the  Joint  Commission  on  Accreditation  while  the  recording  of 
information  in  other  settings  of  care,  e.g.  physicians'  offices,  clinics,  etc.  have 
received  Uttle  attention.  The  following  studies  indicate  some  areas  outside  the 
hospital  where  quaUty  of  care  has  been  reviewed. 
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Huntley  (90)  described  the  "chart  review"  process  in  use  for  the  General 
Clinics  of  the  North  Carolina  Memorial  Hospital.  In  this  study,  a  group  of 
physicians  defined  standards  against  which  they  could  compare  actual  perfor- 
mance via  a  systematic  study  of  medical  records.  Normative  standards  were 
developed  by  the  staff  for  laboratory  tests  and  examinations.  If  abnormaUties 
were  recorded,  a  set  of  foUowup  activities  was  delineated.  The  medical  record 
librarian  did  the  preliminary  review  of  the  chart  according  to  the  predetermined 
criteria.  A  reviewing  physician  then  examined  each  deficiency  or  abnormality  and 
evaluated  the  adequacy  of  the  entire  workup  and  disposition.  A  major  benefit  of 
monitoring  the  quality  of  medical  care  in  the  outpatient  clinic  may  have  been  the 
awareness  of  the  necessity  of  recording  clinical  data. 

Morehead  (126)  compared  the  quality  of  care  provided  in  OEO  Neighbor- 
hood Health  Centers,  a  medical  school  affiliated  hospital  outpatient  department, 
child  and  youth  care,  maternal  and  infant  care,  health  department  well-baby 
clinic,  group  practice  programs  and  rural  private  practitioners.  The  study 
attempted  to  measure  the  extent  to  which  infants,  adult  patients,  pregnant 
patients,  and  post-partum  patients  receive  medical  services  according  to  generally 
accepted  standards  of  care  (baseline  medical  audit).  The  level  of  care  in  medical 
school  outpatient  departments  was  accepted  as  the  standard  to  be  used.  Separate 
sets  of  criteria  were  developed  for  baselines  for  adult  medical,  obstetrical,  and 
pediatric  patients.  Numerical  weighting  was  assigned  to  each  portion  of  the 
criteria  and  comparisons  made. 

Kroeger  (109)  used  physician  office  records  in  a  study  designed  to  evaluate 
quality  of  care  in  the  office  practice  of  internists.  It  demonstrated  the  dearth  of 
available  information  from  physician  office  records.  The  New  York  State  Society 
of  Internal  Medicine  wanted  an  objective  tool  to  evaluate  and  demonstrate  the 
quahty  of  office  care  rendered  by  their  members.  Of  the  sample  physicians' 
offices  visited,  only  67  percent  kept  records  that  the  physician  reviewers  deemed 
adequate  on  the  basis  of  legibility  and  completeness  for  non-physicians  to  review. 
Separate  worksheets  were  developed  for  the  pre-coding  of  80  items  which  were 
considered  to  be  essential  to  the  workup  of  any  patient.  These  were  normative 
standards  developed  by  the  medical  audit  committee  of  the  society.  With 
additional  information  and  tests  necessary  to  make  the  worksheet  for  a  specific 
diagnosis,  the  abstracting  of  essential  data  from  the  physician's  office  records  by 
the  non-physician  seemed  reasonably  reliable.  The  abstracts  were  reviewed  by  a 
group  of  physic'ans  from  the  academic  setting,  as  well  as  private  practice.  No 
guidance  was  given  as  to  specifics  for  evaluating  the  quality  of  care  and  the 
grading  was  the  result  of  the  individuals'  subjective  evaluation  of  the  physicians. 
There  was  uniform  agreement  among  the  group,  despite  the  absence  of  specific 
grading  criteria. 
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The  increasing  concern  directed  towards  quality  of  care  in  reference  to 
process  as  well  as  outcome  evaluation  will  require  increased  attention  to 
recordkeeping  in  all  settings.  Sanazaro  (176)  clearly  states  that  the  information 
base  must  be  described  in  an  agreed-upon,  organized  way,  with  the  set  of 
standards  utilized  for  comparative  purposes.  This  implies  that  a  practical  method 
of  abstracting  and  classifying  data  be  developed.  The  standardization  of 
terminology  of  patient  records  will  have  to  be  accomplished.  The  requirement  for 
the  ability  to  handle  large  amounts  of  data  is  set  forth  by  Weed,  wherein  he  states 
that  the  dimensions  of  quality  control  problems  can  never  be  assessed  until 
computerization  of  the  data  is  accomphshed.  Rapid,  effective  audit;  the 
corresponding  demand  for  expUcitness  in  the  definition  of  problems;  and  the 
orderly  organization  of  the  data  is  the  main  contribution  that  computers  can 
make  towards  improving  the  performance  and  accelerating  the  professional 
development  of  physicians. 

MEASUREMENT  SCALES 

One  of  the  necessary  tools  in  research  on  quality  of  care  is  the  ability  to 
construct  scales  which  measure  a  physician  or  institution  on  a  continuum  from 
best  to  worst.  If  the  objective  is  to  identify  aberrant  patterns  of  performance  and 
correct  those  patterns,  measurement  scales  may  not  be  necessary. 

All  scales  that  measure  quahty  of  care  are  ordinal  and  arranged  in  order  from 
best  to  worst.  The  intervals  between  one  position  on  the  scale  and  the  next  are 
not  equal,  since  one  cannot  say  that  a  physician  who  scores  80  points  is  twice 
as  good  as  one  who  scores  40.  Some  studies  have  used  a  simple  scale  with  few 
divisions  which  classify  care  into  categories  of  excellent,  good,  fair,  or  poor.  Some 
have  even  reduced  the  categories  to  optimal  and  less  than  optimal.  The  major 
disadvantage  of  the  use  of  such  a  scale  with  few  divisions  is  the  possible  loss  of 
information  and  a  lower  ability  to  discriminate. 

Other  studies  assign  scores  to  portions  of  specified  performance  of  care  and 
cumulate  these  to  obtain  a  numerical  index  usually  ranging  from  0  to  1 00.  Some 
believe  that  this  is  the  way  to  preserve  valid  information  and  give  information  on 
performance  with  respect  to  aspects  or  dimensions  of  care  which  constitute  the 
whole.  deRouville's  study  on  peer  review  in  biUary  tract  surgery  utilizes  reporting 
of  final  judgments  by  two  different  methods;  first,  an  evaluation  on  a  five-point 
scale  as  superior,  good,  indeterminant,  poor  and  totally  unacceptable.  Secondly,  a 
final  judgment  using  a  scale  of  only  two  categories,  satisfactory  and  unsatis- 
factory. The  five-point  scale  was  included  since  it  was  believed  that  the 
opportunity  for  the  reviewer  to  make  some  gradation  in  quahty  might  be  more 
satisfactory  to  him  than  a  "yes"  or  "no"  decision.  Obviously,  one  would  rather 
see  the  case  with  exceptional  care  receive  more  credit  than  the  one  which  was  just 
getting  by,  although  each  might  be  worthy  of  a  final  satisfactory  judgment.  On 
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the  other  hand,  it  would  also  appear  unfair  to  rate  the  case  with  only  a  modicum 
of  unsatisfactory  features  in  the  same  class  as  one  in  which  all  phases  have  been 
flagrantly  mishandled  or  neglected.  If  the  reviewer  called  a  case  "indeterminant" 
and  was  so  questionable  that  judgment  could  be  made  either  way,  it  would 
receive  a  final  satisfactory  or  unsatisfactory  judgment.  In  this  study,  there  was  fair 
agreement  between  judgments  made  on  the  five-point  scale  and  those  made  on  the 
binary,  satisfactory /unsatisfactory  scale. 

At  times  it  is  useful  to  be  able  to  attach  a  label  which  represents  a  quality  of 
management  on  the  case  or  the  overall  performance  of  a  provider.  An  example  of 
the  latter  was  the  Care  Component  Score  development  by  Helbig  (84).  This 
system  for  evaluating  quahty  of  inpatient  care  was  developed  to  assess  the  quality 
of  medical  care  provided  to  handicapped  children  using  a  rating  system  to 
evaluate  hospital  performance  and  to  detect  weaknesses  in  specific  components  of 
care.  Fourteen  components  of  in-hospital  care  were  selected  as  means  of 
aggregating  the  impressions  of  the  reviewing  physicians  into  a  composite  score. 
These  components  are  listed  as  follows: 

•  Length  of  hospital  stay, 

•  Justification  for  surgery, 

•  Timing  of  surgery, 

•  Overall  completeness  of  diagnostic  work  up, 

•  Appropriateness  of  routine  laboratory  tests  performed, 

•  Sufficiency  of  number  of  routine  laboratory  tests  performed, 

•  Appropriateness  of  diagnostic  procedures  other  than  routine  laboratory 
tests, 

•  Use  and  appropriateness  of  consultants, 

•  Whether  diagnostic  evaluation  should  have  been  done  on  an  outpatient 
basis. 

•  Appropriateness  of  medical  treatment, 

•  Proficiency  of  medical  treatment, 

•  Whether  therapy  could  have  been  accomplished  on  an  outpatient  basis, 
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•  Adequacy  of  follow-up  arrangements, 

•  Overall  content  and  quality  of  case  summary  itself. 

A  skill  of  quality  levels  was  assigned  to  each  question  and  without 
attempting  to  weight  the  various  questions  as  to  relevant  importance,  a  score  of  2, 
1  or  0  was  assigned  to  each  quahty  level. 

The  quality  level  of  "adequate"  was  assigned  the  score  of  2,  "probably 
inadequate"  a  score  of  1,  and  "very  inadequate"  a  score  of  0.  A  scoring  system 
was  devised  which  relied  on  the  denominator  which  varies  in  proportion  to  the 
number  of  applicable  items  allowing  for  the  variability  in  the  complexity  of  the 
case.  The  reviewing  physician  reviewed  the  judgment  as  to  the  quality  of  what  was 
done  and  indicated  those  components  which  did  not  apply.  A  coder  recorded  the 
denominator  scores  for  those  components  which  did  apply,  coded  the  numerator 
ratings  based  on  the  reviewer's  judgment,  summed  the  numerator  and  the 
denominator,  divided,  and  converted  the  result  to  a  percentage  which  was  the 
final  total  score  for  that  case. 

This  system  produces  tabular  output  which  summarizes  total  percentage 
scores  by  hospital  and  by  diagnostic  categories  and  which  identifies  patterns  of 
performance  by  specific  care  components.  This  experimental  system  was  found  to 
be  adequately  reliable  for  the  purpose  of  the  care  system  and  is  a  discriminating, 
high  volume  means  for  detecting  patterns,  in  some  quantifiable  element,  of 
quality  of  care  by  communicating  these  data  to  hospitals  in  a  form  which  may 
serve  to  encourage  improvement  in  quality  of  care. 

One  of  the  questions  raised  is  whether  the  subscores  can  simply  be  added  or 
whether  some  type  of  weighting  must  be  done;  and  if  other  than  equal  weights  are 
to  be  used,  on  what  basis  the  weights  are  to  be  determined.  For  example, 
Morehead  (126)  in  "Comparison  Between  OEO  Neighborhood  Health  Centers  and 
Other  Health  Center  Providers  of  Ratings  of  the  Quahty  of  Health  Care", 
attached  numbers  to  the  expected  care  for  components  within  a  specialty  which 
were  not  equal  to  each  other,  but  instead  reflected  the  relative  importance  (or 
weight)  in  total  baseline  care.  For  instance,  in  the  baseline  adult  medicine  tables, 
the  history  was  given  a  weight  of  20,  physical  examination  a  weight  of  20, 
whereas  vital  signs  had  a  weight  of  5.  The  components  of  the  pediatrics  baseline 
gave  a  weight  of  30  to  history  and  physical  examination,  a  weight  of  25  for 
immunization  and  a  weight  of  5  for  screening  for  tuberculosis  (clearly  indicating 
the  importance  of  immunization). 

It  is  clear  that  various  methods  of  utilizing  measurement  scales  are  far  from 
perfect  and  will  need  to  be  continually  refined. 
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CONCLUSIONS 


The  following  considerations  are  proposed  for  improving  quality  of  care 
assessment. 

•  The  definition  of  quality  should  go  beyond  the  merely  technical  aspects 
of  care  to  include  the  many  dimensions  that  make  care  meaningful  and 
acceptable  to  clients,  providers,  and  to  the  community  at  large. 

•  The  primary  emphasis  should  be  on  pervasive  patterns  of  care  rather 
than  on  pointing  out  individual  wrong  doing. 

•  The  primary  objective  of  quality  assessment  should  be  educational  and 
rehabilitative  rather  than  punitive  and  destructive. 

•  Methods  of  concurrent  review  for  process  evaluation  and  intervention 
during  the  course  of  management  seem  indicated. 

•  Emphasis  should  be  given  to  positions  of  content,  assessment,  and 
techniques  in  the  ambulatory  care  setting. 
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OUTCOME  APPRAISAL  OF  MEDICAL  CARE 


by  Barry  Decker,  M.D. 

The  prospectus  of  the  CaUfornia  Center  for  Health  Services  Research,  as 
quoted  by  Carl  Hopkins  (81),  provides  a  somewhat  research  oriented,  but  none 
the  less  apt,  definition  of  outcome  evaluation. 

".  .  .  to  improve  the  effectiveness  and  efficiency  of  personal  health  services 
through  research  and  demonstration  focused  on  the  development  and 
test-use  of  criteria  for  measuring  the  outcomes,  on  carefully  defined 
population  groups,  of  selected  practices  and  systems  of  medical  and  related 
services." 

From  a  historic  perspective,  the  use  of  results  to  validate  specific  medical 
processes  is  as  old  as  Hippocrates  and  as  rich  as  clinical  research.  It  is  commonly 
accepted  medical  practice  to  validate  new  chemical  procedures  by  estabUshed 
methods;  to  evaluate  antibiotics  by  their  abihty  to  suppress  bacterial  growth, 
sterilize  body  fluids,  and  induce  clinical  remission;  to  measure  the  value  of  cancer 
chemotherapy  by  the  prolongation  of  Ufe;  and  to  select  surgical  procedures  by 
their  ability  to  preserve  Ufe,  improve  function,  and  minimize  risk. 

In  an  excellent  review,  Lembke  (118)  discussed  the  historic  application  of 
these  professional  principles  to  the  more  circumscribed  field  of  medical  audit, 
which  he  defined  as  a  "systematic  review  and  scientific  evaluation  of  medical 
care".  Shortly  after  1910,  Codman,  who  was  a  prime  mover  in  the  establishment 
of  certification  for  surgeons  and  a  nationwide  survey  of  hospitals,  "described 
forms  and  methods,  and  published  an  abstract  of  every  case  admitted  to  his 
hospital.  .  .  classifying  results  as  favorable  or  unfavorable.  His  system  required  at 
least  one  re-evaluation  of  the  case  a  year  or  more  later,  until  a  condition  of 
stability  permitting  final  judgment  had  been  reached." 

Unfortunately,  political  pressures  at  the  time  dictated  the  use  of  minimal 
hospital  standards  (structural  appraisal)  for  accreditization  rather  than  such 
detailed  audits  of  medical  process  or  end  results  as  Codman  advocated.  The  Joint 
Commission  on  Accreditation  of  Hospitals,  however,  which  continued  this  work 
in  1952,  stimulated  new  interest  in  medical  auditing,  particularly  through 
requirements  for  medical  staff  committees  to  conduct  case  reviews. 

The  need  for  greater  efficiency  and  minimizing  physician  time  in  the 
conduct  of  large  scale  reviews,  and  the  growing  availability  of  computers,  led  to 
the  development  of  abstracting  and  tabulating  systems  to  permit  the  monitoring 
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and  comparative  evaluation  of  specific  indices  of  performance  and  some  indices  of 
end  results.  In  his  review,  Lembke  specifically  recommends  the  comparison  of 
hospital  indices  with  similar  population  based  indices  for  the  service  area. 
Unfortunately,  he  notes,  "when  such  community  incidence  rates  were  employed, 
they  did  not  adequately  distinguish  between  the  quality  of  care  in  individual 
hospitals  where  there  was  more  than  one  hospital  in  the  community.  .  .  and  did 
not  help  to  evaluate  the  work  of  individual  physicians  working  in  the  same 
hospital."  Based  on  his  experience  in  Rochester,  Lembke  recommended  the 
following  base  for  a  modem  scientific  medical  audit: 

(1)  individual  case  analysis,  by  specific  disease  or  operation,  using  explicit, 
objective  criteria; 

(2)  community  wide  epidemiologic  data  to  independently  check  the  results 
obtained  by  case  analysis;  and 

(3)  comparative  analysis  to  determine  the  accuracy  of  tissue,  laboratory, 
and  radiologic  examinations. 

Every  attempt  at  medical  auditing,  and  most  reviews  of  work  in  this  field, 
recognize,  and  at  least  pay  lip  service  to  the  importance  of  outcomes  in  the 
evaluation  of  the  quality  of  medical  care.  Unfortunately,  as  Shapiro  (176)  has 
noted,  "the  desirability  of  determining  quahty  of  medical  care  by  its  effects  on 
some  measurable  aspect  of  health  is  matched  by  the  pessimism  among  researchers 
about  the  possibility  of  success  in  dealing  with  the  issue."  The  pessimism,  which 
Shapiro  noted,  was  entirely  warranted  by  the  scant  number  of  publications 
dealing  with  outcome  evaluation  until  very  recently;  and  by  the  still  existing  lack 
of  uniformly  acceptable  outcome  criteria  and  widely  used  methodologies  for 
outcome  evaluation. 

Given  the  generally  accepted  validity  of  outcome  evaluation,  and  its  failure 
to  be  widely  implemented,  it  seems  reasonable  to  organize  this  state-of-the-art 
paper  around  difficulties  inherent  in  the  conduct  of  outcome  evaluation. 
Accordingly,  the  balance  of  this  paper  will  deal  in  turn  with: 

•  the  definition  of  outcomes 

•  approaches  to  outcome  evaluation 

•  requirements  for  outcome  evaluation 

•  patient  outcome  indicators 
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techniques 


•  comparative  evaluation 

•  implications  for  medical  care  appraisal 

The  Definition  of  Outcomes 

There  is  a  considerable  lack  of  uniformity,  among  various  investigators, 
concerning  the  definition  of  outcomes.  Clearly,  the  complex  interrelationships 
between  real  Ufe  events,  differing  professional  and  non-professional  viewpoints, 
and  the  purposes  of  evaluation  all  contribute  to  this  difficulty. 

The  words  "outcome"  and  "end-result"  have  often  been  used  interchange- 
ably, but,  in  fact,  have  quite  separate  meanings.  An  outcome  may  be  defined  as 
the  result  or  consequence  of  any  process;  an  end-result  is  either  the  final  outcome 
in  a  sequence  or  an  outcome  which  relates  to  the  specific  objective  under 
consideration.  Mortality  is  the  only  uniformly  acceptable  end-result  because  of  its 
self-evident  finahty.  Other  end-result  parameters  used  by  different  investigators 
vary  with  the  purposes  and  the  viewpoint  of  the  evaluator. 

Densen  (45)  classified  end-results  in  accordance  with  varying  viewpoints.  He 
listed  mortality,  morbidity,  and  functional  status  as  end-results  from  the  medical 
viewpoint;  access  to  care  as  an  end-result  from  the  individual  patients  viewpoint; 
and  the  level  of  unmet  health  needs  as  the  end-result  from  the  community 
viewpoint.  Brook  studied  the  quality  of  medicine  in  a  Neighborhood  Health 
Center  (25).  With  a  sensitivity  to  the  multi-dimensional  social  purposes  of  the 
Neighborhood  Health  Center,  he  used  patient  perception  of  the  quality  of  care, 
evidenced  by  compliance,  satisfaction,  and  return,  as  the  end-result  of  organiza- 
tional success.  In  a  study  of  M&I  projects  (124),  Levin  was  primarily  concerned 
with  the  relationship  between  cost  and  product  as  an  outcome  indicator. 
Interestingly,  he  clarified  the  distinction  between  cost-benefit  ratios,  which 
compare  costs  with  medical  benefits  translated  into  dollar  terms,  and  cost- 
effectiveness  ratios,  which  compare  costs  with  health  values  in  non-monetary 
volumetric  terms.  Last  (111),  Johnson  and  Rosenfeld  (90),  and  Vail  (197) 
primarily  emphasize  utilization,  workloads,  waiting  time  and  other  volumetric 
parameters  as  programmatic  outcomes  in  various  health  care  settings. 

In  an  important  work  (171),  Sanazaro  and  Williamson  used  a  modified 
critical  incident  technique  to  study  the  perceptions  of  1211  privately  practicing 
internists  with  academic  appointments,  concerning  effective  and  ineffective 
performance.  They  were  able  to  abstract  6276  end-results  or  outcomes  from  the 
reports  of  2798  patient  care  episodes.  Twelve  major  categories  of  outcomes  were 
derived  from  this  material. 
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"A  basic  distinction  was  made  between  'patient  end-results'  and  'process 
outcomes.'  In  the  former,  the  end-results  refer  specifically  to  changes  in  the 
patient  as  a  person  or  in  the  attributes  of  the  disease  or  condition.  The  six 
major  categories  so  classified  are:  changes  in  longevity,  physical  abnormali- 
ties, physical  symptoms,  psychological  abnormalities,  psychological  symp- 
toms, and  function.  Changes  in  any  of  these  for  the  better,  or  more 
commonly,  for  the  worse  can  and  do  occur  during  the  natural  history  of  the 
disease.  None  of  these  categories  is  uniquely  dependent  upon  medical 
intervention.  In  contrast,  process  outcomes  occur  only  when  the  patient 
receives  medical  care.  The  six  categories,  so  classified  are:  attitudes  toward 
the  physician  and  the  episode  of  care,  attitudes  toward  and  understanding  of 
the  condition,  compliance,  incurring  or  avoiding  unnecessary  risks  in  medical 
care,  hospitalization,  and  costs  of  care.  These  do  not  occur  during  the 
natural  history  of  disease  in  the  absence  of  medical  intervention." 

The  California  Center  for  Health  Services  Research,  according  to  Hopkins 
(81),  "will  seek  to  develop  and  apply  unproved  criteria  for  determining  the 
outcomes  of  personal  health  services,  including,  (a)  health  status  of  persons  served 
(mortality,  morbidity,  disability),  (b)  volume  of  services  provided,  (c)  cost 
effectiveness  of  services  provided,  and  (d)  quality  indexes  such  as  peer  judgment 
(medical  audits)  and  patient  attitudes." 

The  multiplicity  of  approaches  to  the  definition  and  classification  of 
outcomes,  evident  in  the  Hterature,  strongly  suggests  that  none  has  universal 
appUcability.  The  practical  purposes  for  which  this  paper  was  written,  however, 
require  precise  definitions  and  common  usage. 

It  is  suggested  that  the  use  of  the  term  "end-results"  be  discontinued  for  two 
reasons.  The  first  is  the  variable  nature  of  "end"  results  depending  upon  the 
purposes  and  the  perspectives  of  the  evaluator.  The  second  is  that  the  term 
implies  a  discordance  with  the  need  for  continuing  medical  care  and,  in  a 
linguistic  sense,  is  in  conflict  with  the  major  thrust  of  contemporary  medicine. 

The  following  specific  definitions  are  suggested: 

The  results  or  consequences  of  any  disease  or  medical  intervention,  whether 
intermediary  or  final,  are  outcomes;  outcome  evaluation  is  the  measurement  and 
collection  of  such  results  for  comparison  with  accepted  standards.  Because  of 
differing  purposes  and  data  sources,  it  is  suggested  that  outcome  parameters  be 
classified  as: 

Patient  Outcomes  —  mortality  or  survival,  physical  or  psychological 
morbidity,  and  level  of  function 
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Process  Outcomes  —  patient  satisfaction,  understanding  of  disease,  compli- 
ance with  medical  regimens,  and  altered  level  of  risk 

Administrative  Outcomes  —  utilization,  work  loads,  time  intervals,  and  other 
volumetric  measures  of  managerial  interest 

Economic  Outcomes  -  cost-benefit  or  cost-effectiveness  measures. 

Approaches  to  Outcome  Evaluation 

Shapiro  (176)  has  called  attention  to  the  difference  between  direct  and 
indirect  methods  for  outcome  evaluation.  The  former  require  a  carefully 
structured  environment,  with  experimental  and  control  groups  differing  or 
adjusted  to  differ  only  for  the  test  variable.  In  the  direct  approach,  outcome 
parameters  are  prospectively  collected  to  measure  the  influence  of  the  test 
variable.  In  contrast,  indirect  methods  begin  by  detecting  differences  in  outcome 
parameters  for  subsequent  retrospective  analysis  of  the  reasons  for  these  observed 
differences. 

The  direct  approach  to  outcome  evaluation  is  most  useful  in  health  service 
research  to  validate  specific  hypotheses.  The  nature  of  this  effort  and  limited 
sample  sizes  permit  one  to  structure  such  ideal  circumstances.  The  indirect 
approach,  on  the  other  hand,  is  far  more  useful  in  medical  care  appraisal,  where 
monitored  results,  explanations,  and  subsequent  modification  of  performance  are 
the  major  goals. 

In  summarizing  the  distinction  between  direct  and  indirect  approaches, 
Shapiro  succinctly  observed, 

"In  short,  the  application  of  the  indirect  approach  in  end-result  studies 
will.. ..depend  on  a  careful  determination  of  the  appropriateness  of  extending 
the  results  from  direct  studies  to  other  situations  and  an  assessment  of  the 
quahfications  of  doing  so  in  a  specific  instance.  Despite  these  comphcations, 
the  indirect  method  should  have  a  great  appeal.  It  does  not  require  the 
observation  of  two  groups  for  later  comparison  and  study  can  usually  be 
carried  out  relatively  quickly.  Often  conclusions  could  probably  be  based  on 
the  existing  information  and  modest  extentions  of  it.  The  rub,  is  that  the 
indirect  approach  must  wait  for  evidence  from  the  direct  method  and  this 
has  been  a  long  time  in  coming." 

In  the  direct  approach,  the  collection  of  outcome  parameters  concludes  the 
study;  in  the  indirect  approach  observed  outcome  parameters  initiate  the 
study.  Nevertheless,  despite  these  sequential  differences,  both  methods  depend 
upon  the  same  elements  of  evaluation,  including: 
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(1)  Outcome  Parameters  —  the  dependent  variable  results  or  consequences 
of  disease  and/or  medical  intervention; 

(2)  Evaluation  Objectives  -  the  independent  or  test  variables  under  investi- 
gation, such  as  the  adequacy  of  a  medical  regimen,  or  the  quality  of 
medical  care  in  a  specific  setting; 

(3)  Evaluation  Subjects  —  physicians,  hospitals,  health  service  systems, 
patients,  or  populations; 

(4)  Evaluation  Design  -  experimental  (direct)  or  analytic  (indirect) 
methods  to  control  or  adjust  for  extraneous  variables. 

Controlled  or  adjusted  comparison  is  common  to  all  outcome  evaluation 
approaches.  The  evaluation  subjects  may  be  compared  with  each  other  at  any 
point  in  time;  with  themselves  longitudinally  over  a  period  of  time;  or  with 
normative  standards  or  empiric  averages.  The  comparisons  may  be  specific  for 
diseases,  procedures,  geographic  areas,  or  patient  mixes. 

Medalie  and  Mann  (132)  offer  an  example  of  the  potential  for  outcome 
evaluation  comparisons.  Their  objective  was  to  evaluate  the  quality  of  medical 
care  in  a  Neighborhood  Health  Center  in  Jerusalem. 

"The  four  major  methods  by  which  the  work  of  the  Health  Center  could  be 
evaluated  are: 

(1)  By  comparing  data  for  the  neighborhood's  health  state  before  the 
Center  began  functioning  against  data  at  the  end  of  certain  periods. 
However,  the  program  was  initiated  without  any  real  consideration  or 
pre-planning  for  evaluation,  thus  ruling  out  this  important  method  of 
comparison. 

(2)  By  comparing  the  neighborhood  with  a  similar  one,  but  with  a  different 
type  of  health  service.  Unfortunately,  we  were  unable  to  find  a 
neighborhood  which  was  comparable  in  its  demographic  structure,  as 
well  as  having  reliable  statistics. 

(3)  By  extracting  from  the  national  figures  a  matched  sample.  Unfortu- 
nately, suitable  data  were  lacking. 
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(4)  By  comparing  the  local  figures  with  the  national  ones  on  a  "one-shot" 
basis,  as  well  as  using  the  latter  as  a  "moving  indicator".  We  were  forced 
to  use  this  as  the  main  method,  in  addition  to  more  subjective  ones, 
such  as  discussing  whether  the  center  had  carried  out  its  pre-determined 
principle  of  practice,  as  set  out  above." 

Most  outcome  evaluations,  published  in  the  literature,  can  be  classified,  and 
perhaps  best  appreciated,  in  relation  to  their  varied  purposes:  (1)  Evaluation 
Research,  (2)  Health  Services  Research,  and  (3)  Managerial  Evaluation. 

Evaluation  research  provides  the  development  and  validation  of  both  criteria 
and  methodologies  for  outcome  evaluation.  It  is  a  rigorous  discipline  whose  goal  is 
to  provide  tools  for  other  investigators.  Health  Services  Research,  an  equally 
rigorous  discipline,  uses  these  tools  with  an  emphasis  on  the  comparative  analysis 
of  different  health  delivery  models.  Both  approaches  generally  deal  with  small 
samples  and  well  controlled,  prospective  direct  methods;  neither  approach  accepts 
ongoing  managerial  responsibilities. 

Managerial  evaluations,  on  the  other  hand,  are  designed  to  monitor  outcome 
performance  in  order  to  detect  unusual  trends  for  in-depth  analytic  study  and 
corrective  action.  Managerial  evaluations  tend  to  use  indirect  methods  to  compare 
individual  or  group  performance  with  accepted  outcome  standards.  A  rigorous 
approach  is  often  compromised  by  the  volume  of  work  and  the  competing 
demands  of  ongoing  operational  activities.  Managerial  evaluations  are  entirely 
dependent  upon  the  prior  development  and  acceptance  of  outcome  performance 
standards  and  methods  of  evaluation,  usually  validated  by  other  more  rigorous 
approaches. 

A  number  of  performance  standards,  covering  administrative  and  economic 
outcomes,  are  available  for  managerial  evaluation.  These  standards  are  generally 
empirically  derived  and  include  examples  such  as  the  PAS  length  of  stay  norms  by 
diagnosis,  and  regional  levels  for  customary  and  usual  fees.  Normative  perfor- 
mance standards  for  the  frequency  of  ambulatory  visits  by  diagnosis  are  now 
being  developed  in  a  number  of  EMCRO's  and  will  be  available  for  managerial 
evaluation. 

Performance  standards,  for  managerial  use,  covering  patient  and  process 
outcomes  are  not  yet  commonly  available.  John  Williamson's  Health  Accountant 
Approach  (208)  offers  a  strategy  for  the  intra-institutional  setting  of  such 
standards  as  well  as  a  means  for  the  conduct  of  managerial  outcome  evaluations. 
This  approach  will  be  discussed  at  greater  length  in  the  section  of  this  paper 
dealing  with  techniques. 
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Requirements  for  Outcome  Evaluation 

All  evaluation  depends  upon  the  availability  of  subjects  for  study.  The 
interaction  between  patients  and  physicians,  in  various  settings,  provides  the 
laboratory  for  medical  evaluation.  Classic  medical  auditing,  and  most  similar 
forms  of  process  evaluation,  deal  only  with  the  brief  time  interval  during  which 
medical  interactions  occurred  when  services  were  actually  delivered.  In  contrast, 
outcome  evaluation  poses  an  additional  requirement  for  follow  up  information 
concerning  the  results  or  consequences  of  the  patient-physician  interaction.  This 
requirement  is  particularly  pertinent  to  those  evaluations  dealing  with  patient  or 
process  outcomes. 

Follow-up  data  for  outcome  evaluation  may  be  sought  directly  through 
longitudinal  studies  of  specific  patients.  This  approach  was  suggested  very  early 
by  Codman,  has  been  used  extensively  in  clinical  investigation,  and  has  provided 
the  design  for  most  prospective  health  services  research  involving  outcome 
evaluation.  This  approach  is  also  uniquely  suited  to  outcome  evaluation  in  prepaid 
group  practice,  where  a  specific  medical  resource  is  responsible  for  the  total  and 
continuing  care  of  a  defined  population  ( 1 76). 

Indirect  methods  for  the  collection  of  follow  up  outcomes  are  also  available 
and  are  generally  more  pertinent  to  the  requirements  of  large  scale  medical  care 
appraisal  in  non-group  settings.  These  methods  depend  upon  the  collection  of 
vital  statistics,  household  survey  data,  or  the  application  of  epidemiologic 
estimates  to  specific  populations  for  whom  an  aggregate  of  medical  providers  are 
responsible.  The  ability  to  identify  such  defined  populations,  and  to  retrieve  other 
sources  of  Unked  data  describing  the  population,  are  obvious  requirements  for  this 
approach.  Lembke  (118)  advocated  the  use  of  such  epidemiologic  indices  as  an 
independent  check  on  case  audits.  The  National  Academy  of  Science  (77)  has 
developed  a  tracer  methodology,  dependent  upon  this  approach,  which  will  be 
discussed  in  greater  detail  later  in  this  paper. 

The  collection  of  outcome  data,  from  defined  populations  served  by  an 
aggregate  of  medical  providers,  also  serves  to  define  unmet  medical  needs  and  to 
determine  the  impact  of  a  specific  program  on  its  target  community.  This  use  of 
indirect  outcome  methods  is  equally  pertinent  to  prepaid  and  non-group  settings 
of  practice.  The  work  of  Decker  (42),  in  the  Northeast  Ohio  Regional  Medical 
Program,  comparing  population  based  hospital  discharges  for  specific  diseases 
with  mortality  in  the  same  populations  is  a  good  example  of  this  usage. 

It  has  already  been  suggested  that  follow  up  information  is  most  necessary 
for  patient  and  process  outcomes  which  deal  with  altered  health  status  and 
patient  satisfaction;  or  conversely,  that  most  administrative  and  certain  cost 
outcomes  are  already  evident  at  the  time  that  services  are  delivered.  To  the  extent 
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that  administrative  and  cost  concerns  are  viewed  only  from  the  provider  or 
institutional  perspective,  this  is  true.  From  the  viewpoint  of  social  planning  and 
public  administration,  however,  populations  rather  than  institutions  are  the  prime 
denominator.  To  meet  these  evaluatory  requirements,  administrative  outcome 
indicators  need  be  aggregated  in  terms  of  the  population  served.  For  example,  the 
number  of  visits  to  a  specific  diabetic  clinic,  need  be  translated  into  the  number 
of  visits  for  diabetes  per  thousand  population  or  per  thousand  population  at  risk. 
Densen  (81)  aptly  described  the  former  approach  as  administrative  or  professional 
centering  and  the  latter  as  population  or  patient  centering.  Clearly,  patient 
centered  outcome  evaluation  requires  the  definition  and  appropriate  aggregation 
of  outcome  data  by  service  populations  even  though  the  nature  of  the 
administrative  outcomes  do  not  require  longitudinal  follow  up. 

One  additional  requirement  for  outcome  evaluation  has  been  stressed  by  a 
number  of  investigators;  namely,  the  need  for  adequate,  accurate,  and  well 
designed  record  systems.  As  Densen  (81)  has  aptly  stated,  "if  we  wish  to  get  on 
with  the  task  of  evaluation  ...  I  wish  to  point  out  the  importance,  indeed  the 
absolute  necessity,  of  an  effective  record  keeping  system  ...  to  appraise  health 
care  services  and  programs." 

Cammam  (30)  has  described  a  computerized  summary  of  patient  records  in 
the  diabetic  clinic  of  University  Hospitals,  Cleveland.  She  pointed  out  the 
increased  legibility  and  use  of  the  records,  emphasizing  both  the  service  and 
investigational  potential  for  such  completely  integrated  and  retrievable  records. 
Weed  (199)  is  developing  a  computerized  problem  oriented  record.  While  his 
primary  motive  is  process  evaluation  of  the  individual  student  or  practitioner,  the 
potential  for  in-depth  outcome  evaluation  from  such  detailed  and  easily 
retrievable  longitudinal  records  is  obvious. 

Densen  (81)  has  emphasized  that,  "for  evaluation  purposes,  the  approach  to 
the  record  keeping  system  should  be  made  from  an  edpidemiological  point  of 
view  —  not  a  computer  or  accounting  point  of  view.  This  means  identifying  the 
population  at  risk  and  those  individuals  in  the  population  who  experience  this 
risk."  Because  of  his  concern  for  public  accountability  and  measuring  the  extent 
to  which  health  program  objectives  are  achieved  in  outcome  terms,  Densen  has 
emphasized  the  need  for: 

(1)  record  systems  maintained  on  a  population  or  patient  basis  rather  than 
on  an  accounting,  administrative,  or  professional  basis,  and 

(2)  the  linkage  of  health  service  records  with  other  bodies  of  outcome  data 
such  as  vital  statistics. 
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Dearing  (40)  has  described  the  basic  items  of  information  for  a  record 
system  as  developed  by  the  Group  Health  Association  of  America  Research  and 
Statistics  Division.  This  system  includes  a  population  file  to  describe  each 
subscriber  and  a  utilization  file  to  describe  each  specific  service.  With  proper 
linkage,  the  system  provides  the  opportunity  to  develop  indices  of  service  both  in 
relation  to  the  population  served  and  to  management  centers. 

In  essence,  these  observations  can  be  succinctly  summarized  in  the  following 
requirements  for  outcome  evaluation: 

(1)  longitudinal  follow  up  of  specific  patients  for  controlled,  direct 
outcome  evaluations,  as  in  health  service  research; 

(2)  A  defined  population  for  study,  to  permit  the  independent  collection 
of  outcome  parameters  for  indirect  outcome  evaluation,  as  in  most 
medical  care  appraisal;  and 

(3)  record  systems  developed  on  a  population  basis  to  permit  linkage  with 
other  outcome  data  sources  and  to  permit  the  evaluation  of  services  in 
relation  to  community  rather  than  administrative  or  professional  needs. 

Patient  Outcome  Indicators 

One  of  the  major  difficulties  preventing  the  more  widespread  use  of  outcome 
evaluation  has  been  the  lack  of  suitable  and  acceptable  indicators  for  the  health 
status  of  patients  and  populations.  This  section  discusses  several  approaches  to 
this  problem. 

Hagner,  LoCicero,  and  Steiger  (76)  studied  patient  outcomes  in  a  sample  of 
174  selected  patients  registered  at  the  Comprehensive  Medicine  Clinic  of  the 
Temple  University  Medical  Center.  "Two  independent  judges  measured  outcomes 
by  using  a  rating  scale  that  attempted  to  make  explicit  the  criteria  of  change. 
Considerable  mutual  training  took  place  between  the  judges,  and  a  reasonably 
high  reliabiHty  was  achieved."  The  commitment  of  professional  time  to  interviews 
makes  this  approach  impractical  for  large  scale  medical  care  appraisal.  Neverthe- 
less, the  example  is  quoted  to  illustrate  the  commonest  available  method  for 
estimating  health  status,  namely,  the  codification  of  multiple,  explicit,  expert 
opinions. 

In  certain  medical  situations,  objective  tests  are  available  to  verify  the 
necessity  for  treatment  or  quantify  patient  improvement.  The  work  of  Sparling 
(188)  comparing  the  percentage  of  pathologically  positive  appendectomies 
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(ruptured  or  acute)  in  five  Baltimore  hospitals  is  an  example.  Similar  usage  pro- 
vides other  objective  patient  outcome  indicators  in  the  clinical  laboratory, 
radiology  department,  or  surgical  pathology  suite. 

Patients  with  chronic  diseases  present  special  problems  for  quantification. 
The  Barthel  Index  (1 29)  measures  the  degree  of  independence  in  performing  most 
routine  functions  and  has  been  used  to  measure  the  results  of  rehabilitation. 
Ellwood  (60)  has  described  the  approach  used  at  the  Kenny  Rehabilitation 
Institute  to  integrate  multiple  semi-objective  criteria  to  grade  the  patient's  level  of 
rehabilitation.  Densen  (45)  has  commented  on  the  multiplicity  of  indicators  to 
quantify  the  Activities  of  Daily  Living.  He  recommends,  and  is  now  working  on,  a 
uniform  scale.  Criteria  to  justify  the  diagnosis,  and  more  importantly,  scales  to 
measure  alterations  in  the  level  of  the  disease  have  been  recommended  by 
professional  specialty  societies  for  rheumatoid  arthritis  and  rheumatic  fever. 

Mortahty  is  a  common  patient  outcome  indicator  which  has  been  widely 
used  in  epidemiology,  clinical  research,  and  in  the  monitoring  of  hospital  care. 
Techniques  for  the  treatment  and  age,  sex,  and  race  adjustment  of  both  crude  and 
disease  specific  mortality  rates  are  well  established  in  the  hterature. 

Relative  survival  rates  are  a  variant  of  mortality  data  and  a  useful  criterion 
for  measuring  the  effectiveness  of  treatment  for  most  chronic  diseases.  Axtell  (10) 
has  presented  a  simple  method  for  analyzing  the  survival  experience  of  a  small 
series  of  patients  based  on  five  year  survival  probabilities  computed  by  the 
National  Office  of  Vital  Statistics.  The  method  has  the  specific  advantage  of  being 
easily  automated. 

Decker  (42)  has  utilized  regional  disease  specific  mortality  rates,  in 
frequently  fatal  diseases,  as  a  surrogate  for  prevalence  in  comparison  with 
population  based  hospital  utilization  for  these  same  diseases.  The  method 
permitted  comparative  studies  of  the  use  of  hospitals  in  relation  to  need  for 
different  populations  defined  by  socio-economic  considerations. 

Roemer,  Moustafa,  and  Hopkins  (167)  have  attempted  to  utilize  crude 
hospital  mortality  rates  to  compare  the  quaUty  of  different  hospitals  in  Southern 
CaUfornia.  They  recognized  that  hospital  mortality  is  often  a  function  of  patient 
mix.  Their  studies  demonstrated  that  crude  hospital  mortahty  correlated  best 
with  length  of  stay  or  occupancy  adjusted  length  of  stay  which  they  accepted  as  a 
surrogate  for  the  severity  of  the  patient  mix.  They  recommended  use  of  the 
hospital  death  rate  adjusted  for  severity  by  occupancy  adjusted  length  of  stay  as 
"a  more  objective  outcome  measure  of  the  overall  quality  of  hospital  performance 
than  the  currently  used  measurements  based  principally  on  examination  of 
hospital  inputs". 
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Several  major  efforts  have  been  conducted  to  quantify  the  health  status  of  a 
population.  Chiang  (32)  attempted  to  define  an  index  of  health  by  mathematical 
models  which  incorporate  the  number  of  illnesses,  the  duration  of  illness,  and  the 
time  lost  to  death  in  a  specific  population.  Unfortunately  data  limitations  forced 
the  use  of  physician  visits  as  a  surrogate  for  the  number  of  illnesses  and  required 
total  exclusion  of  the  severity  of  disease  from  consideration. 

Lawton,  Ward,  and  Yaffee  (112)  used  the  statistical  technique  of  factor 
analysis  to  define  the  dimensions  of  health  among  older  men  and  women.  Their 
data  sources  included  interviews  with  149  residents  of  an  old  age  housing  unit, 
medical  examinations  and  pertinent  records.  Their  findings  suggested  multiple 
rather  than  unitary  definitions  of  health  depending  upon  the  perspective  used 
(patient,  physician,  or  behavioral)  and  the  use  of  the  index  (life  insurance, 
military  service,  etc.). 

Sanders  (174)  editorially  explored  the  paradox  of  a  high  level  of  chronic 
disease  morbidity  in  Kit  Carson  County  in  the  presence  of  low  mortality,  good 
medical  resources  and  reasonable  utilization.  He  deduced  that  good  medical  care 
leads  to  prelongation  of  life  and  a  high  rather  than  a  low  level  of  chronic  disease. 
He  suggests  modifying  life  tables  for  full  function  life  expectancy  and  measuring 
community  health  levels  in  terms  of  anticipated  productive  man  years.  He  places 
particular  emphasis  on  the  use  of  this  parameter  in  determining  the  allocation  of 
medical  resources. 

Techniques  for  Outcome  Evaluation 

The  techniques  for  outcome  evaluation  are  as  numerous  as  the  investigators 
performing  them.  In  essence,  each  study  defines  its  own  methodology  in  relation 
to  specific  objectives.  In  this  section,  three  studies  illustrating  specific  approaches 
and  two  generalized  techniques,  recently  introduced,  will  be  discussed. 

Thompson,  Marquis,  Woodward  and  Yeoman  (195)  compared  perinatal 
mortality  in  two  Air  Force  hospitals.  Their  assumptions  were  that  differences  in 
the  populations  served,  limited  access  to  medical  care  related  to  financial  barriers, 
and  quality  differences  related  to  the  organization  for  the  delivery  of  medical  care 
would  be  minimized  in  the  comparison  of  two  Air  Force  Hospitals.  Perinatal 
mortaUty  and  prematurity  (birth  weight  of  less  than  2,500  grams)  were  used  as 
outcome  parameters  for  this  evaluation.  The  authors  found  no  significant 
difference  between  these  rates  in  the  two  institutions.  Careful  evaluation  of  the 
data,  however,  revealed  that: 
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•  black  mothers  had  significantly  higher  perinatal  mortality  in  one 
hospital; 

•  white  primiparas  had  significantly  higher  perinatal  mortality  in  the 
other  hospital;  and 

•  oriental  mothers  with  white  Caucasian  husbands  had  the  highest 
perinatal  mortality  in  both  hospitals. 

Thompson  et.  al.  were  unable  to  find  adequate  explanations  for  these 
specific  findings.  The  importance  of  this  study  is  to  illustrate  the  use  of  outcome 
evaluation  to  compare  two  institutions  and  to  generate  research  questions  for 
further  study. 

Brook  and  Stevenson  (24)  studied  a  cohort  of  141  non-emergent  patients  at 
the  Baltimore  City  Hospital  Emergency  Room,  selected  by  virtue  of  their  referral 
to  the  radiology  department  for  gastro-intestinal,  barium  x-ray,  or  gall  bladder 
studies.  Simple  process  criteria  were  developed  for  minimal  diagnostic  workup 
and  minimal  therapeutic  follow  up.  Patient  outcomes,  including  longevity,  level  of 
further  symptomatology,  work  loss,  hospitalization  and  surgery  were  determined 
by  patient  interviews  and  were  compared  with  diagnostic  and  therapeutic 
processes  as  evidenced  in  the  record. 

Inefficiencies  in  the  diagnostic  process  were  noted  by  the  authors.  "Of  the 
131  patients  interviewed,  40  (30  percent)  sought  additional  professional  help  from 
other  sources  of  care.  Furthermore,  only  37  patients  out  of  the  98  interviewed 
patients  who  had  completed  an  x-ray  examination  (38  percent)  could  recall  being 
told  the  results  or  had  any  knowledge  of  the  results." 

Similar  inadequacies  in  the  therapeutic  process  were  noted.  Even  with 
minimal  process  treatment  criteria,  "only  37  percent  of  patients  with  abnormal 
results  appeared  to  be  receiving  appropriate  therapy." 

An  attempt  was  made  to  compare  outcome  parameters  to  this  inadequate 
medical  care.  "Examination  of  the  cohort  of  patients  with  duodenal  ulcers 
revealed  that  only  one  out  of  these  nine  patients  received  therapy;  he  missed  less 
than  one  week  of  work  and  was  asymptomatic  at  follow-up  interview.  Of  the 
remaining  eight,  six  missed  more  than  one  week  of  work,  and  all  eight  retained 
the  previous  levels  of  symptoms  at  follow-up  study."  Brook  and  Stevenson 
concluded  that  poor  quality  care  was  evident  at  one  of  Baltimore's  best 
institutions  despite  the  adequacy  of  its  staffing  and  the  minimal  nature  of  the 
criteria  used. 
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Last  and  White  (110)  studied  the  content  of  medical  care  in  eight  general 
practices  in  Vermont  using  Eimerl's  method  for  indexing  conditions  and  simple 
modifications  to  record  outcomes.  While  the  specific  study  was  too  small  to  draw 
valid  conclusions  regarding  the  content  of  general  practice,  it  did  demonstrate  a 
simple  reproducible  method  for  evaluating  administrative  outcomes  in  practice. 
They  were  able  to  document  the  comparative  practices  with  regard  to  diagnostic 
mix,  age  and  sex,  referral  rates,  hospitalization  rates,  visits  per  condition,  and 
contacts  per  patient. 

The  National  Academy  of  Sciences  (77)  has  developed  an  interesting 
methodology  for  the  evaluation  of  the  quahty  of  care  in  Neighborhood  Health 
Centers  which  may  have  wide  applicability  for  medical  care  appraisal  in  general. 
The  methodology  depends  upon  the  identification  of  a  specific  population  for 
which  a  provider  (or  group  of  providers  in  the  aggregate)  are  responsible.  There  is 
a  clear  indication  that  provider  responsibility  is  seen  to  extend  to  the  health  of 
the  population  and  not  to  the  more  limited  requirements  of  symptomatic  health 
care.  Application  of  this  plan  also  requires  the  availability  of  demographic 
information  characterizing  the  service  population. 

Certain  specific  diseases  were  selected  as  suitable  tracers  to  monitor  health 
care  in  this  setting,  because  of : 

•  a  significant  impact  on  the  population 

•  easy  diagnosis 

•  high  prevalence 

•  known  care  which  can  alter  the  course  of  the  disease 

•  existing  consensus  concerning  appropriate  care 

•  well  defined  epidemiology. 

Six  diseases,  from  a  larger  list,  satisfied  these  criteria  and  were  selected  as 
tracers.  They  included:  (1)  middle  ear  infection  with  or  without  hearing  loss,  (2) 
visual  disorders,  (3)  iron  deficiency  anemia,  (4)  cervical  carcinoma,  (5)  essential 
hypertention,  and  (6)  urinary  tract  infection. 

Process  standards  for  desirable  medical  care  were  developed  for  each  of  these 
conditions  and  documentation  of  the  known  epidemiology  compiled.  The 
evaluation  plan  involves  both  an  outcome  evaluation  of  the  Neighborhood  Health 
Center's  impact  on  its  target  population  by  edpidemiologic  methods  and  a  process 
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iaudit  of  the  quality  of  medical  care  rendered.  The  methodology  is  sound,  well 
documented,  and  applicable  to  any  situation  where  an  aggregation  of  medical 
resources  accepts  responsibihty  for  the  health  of  a  defined  population. 


A  generally  utilizable  strategy  for  relating  outcome  and  process  assessment 
has  been  proposed  by  John  Wilhamson  (207)  and  is  being  implemented  with  the 
support  of  NCHSR&D  for  his  Health  Accountant  Project  (208).  This  work  was 
referred  to  earlier,  and  provides  a  means  for  the  setting  of  outcome  performance 
standards  within  an  institution  to  permit  managerial  outcome  evaluations. 

Williamson's  basic  assumption  is  that  all  medical  process  does  not  need  to  be 
studied;  rather,  the  first  problem  for  study  is  to  identify  those  processes  in  need 
of  corrective  study  or  action  based  on  inadequate  outcomes.  With  minor 
translation  he  envisions  medical  care  to  involve  the  following  dynamic  events: 


Diagnostic  processes   Diagnostic  ^ 

(Process  Outcomes) 

Results 

Therapeutic   Therapeutic  (Patient 

Processes  Results  Outcomes) 


For  any  given  diagnosis,  his  studies  are  designed  to  establish  the  percentage 
of  false  positive  diagnoses  (erroneously  diagnosed)  and  the  percentage  of  false 
negative  diagnoses  (undiagnosed  cases).  When  deviations  from  self  determined 
expectations  exceed  the  95%  confidence  level,  evidence  exists  of  the  need  for 
further  process  evaluation  and  educational  correction.  Though  not  made  expUcit 
in  Williamson's  work,  this  approach  requires  the  ability  to  identify  accurate 
diagnoses  by  a  specific  test  or  the  application  of  a  defined  set  of  criteria. 


The  adequacy  of  therapy  is  measured  by  an  available  outcome  parameter, 
again  seeking  deviation  from  self  determined  expectations  beyond  the  95  percent 
confidence  level  to  indicate  problems  for  further  evaluation  and  educational 
correction.  In  the  illustrations  quoted,  Williamson  used  acceptable  mortality  as 
the  outcome  measure,  however,  the  technique  would  be  easily  adaptable  to  any 
other  available  and  measurable  outcome. 


The  approach  has  conceptual  advantages  to  recommend  it.  It  may  also  avoid 
considerable  wasted  effort  measuring  processes,  through  medical  audits,  which 
make  Uttle  difference  in  outcomes. 


Comparative  Evaluations 


The  important  use  of  outcome  evaluation  to  validate  or  question  process 
evaluation  is  illustrated  by  the  following  studies. 
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Brook,  Appel,  Avery,  Orman  and  Stevenson  (26)  studied  the  effectiveness  of 
inpatient  follow-up  care  during  the  course  of  403  discharges  from  the  medical 
service  of  a  teaching  hospital.  The  patients  all  had  chronic  diseases  and  were 
studied  by  both  record  review  and  interview.  Outcome  measures  included  the 
current  state  of  symptoms,  activity  levels,  and  ambulatory  function.  Process 
measures  included  the  frequency  of  post  discharge  visits,  compliance  with  the 
prescribed  medical  regimen,  and  the  presence  of  a  designated  source  of  continuing 
care  at  the  time  of  the  follow-up  visit.  Based  on  the  application  of  minimal 
criteria,  which  almost  any  physician  would  accept,  only  66  percent  of  the 
discharged  patients  received  acceptable  follow-up  care. 

"There  was  a  significant  correlation  between  medical  care  process  and 
outcome.  A  large  percentage  of  the  variation  in  the  outcome  variable,  however, 
was  not  explained  by  the  process  variable.  Since  patient  outcome  depends  on 
many  non-medical  as  well  as  medical  factors,  outcome  cannot  be  predicted 
through  examination  of  the  medical  process  alone.  Evaluation  of  the  effectiveness 
of  medical  care  is  dependent  on  collection  of  both  process  and  outcome  data." 

Heifer  (78)  estimated  the  quahty  of  patient  care  in  a  pediatric  emergency 
room  with  internally  developed  process  criteria  for  an  adequate  physical  and 
history.  Independently,  an  expert  subjective  judgment  of  the  quality  of  care  was 
made  retrospectively  by  a  senior  staff  physician.  When  knowledge  of  the  details  of 
the  audit  was  disseminated  among  the  interns,  who  staffed  the  pediatric 
emergency  room,  there  was  significantly  greater  compliance  with  the  process 
criteria  but  only  modest  gains  in  the  quahty  of  care,  as  separately  judged  by 
experts.  This  study  raises  doubts  about  the  value  of  process  conformity  or  the 
specific  process  criteria  chosen  for  the  experiment. 

Lewis,  Resnik,  Schmidt,  and  Waxman  (125)  studied  five  major  chronic 
disease  diagnoses  among  66  subjects  randomly  allocated  to  a  regular  medical 
school  clinic  and  to  an  experimental  nurse  practitioner  clinic.  The  study  was 
duplicated  in  a  metropolitan  general  hospital  with  53  patients  cared  for  by  the 
nurse  practitioner  and  85  patients  followed  in  the  regular  medical  clinic. 

Nurse  practitioners  were  asked  to  report  critical  incidents  in  treatment 
according  to  the  model  previously  described  by  Sanazaro  and  Williamson  (171). 
These  critical  incidents  differed  from  those  which  Sanazaro  and  Williamson 
gathered  from  internists.  Not  surprisingly,  the  nurses  emphasized  supportive 
activities,  while  the  internists  emphasized  diagnostic  activities.  The  nature  of  the 
study  population,  including  patients  with  established  chronic  diseases,  may  have 
contributed  to  this  difference. 
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Lewis  et.al.  estimated  outcomes  in  both  the  nurse  practitioner  and  physician 
treated  patients  by  the  following  parameters: 

•  mortality 

•  increase  in  employment 

•  level  of  discomfort 

•  broken  appointments 

•  criticisms  of  the  medical  care  received 

•  use  of  other  medical  care  resources 

By  all  outcome  criteria  measured,  the  patients  treated  by  nurse  practitioners 
demonstrated  results  as  good  or  better  than  those  treated  by  physicians.  The 
implication  that  care  oriented  towards  a  supportive  role  for  patients  with  chronic 
disease  may  be  more  beneficial,  has  important  implications  for  the  validity  of 
process  criteria  for  care,  in  similar  diseases,  generated  by  diagnostically  oriented 
physicians. 

Implications  for  Medical  Care  Appraisal 

Despite  early  recommendations  favoring  outcome  evaluation,  medical  care 
appraisal  has  been  dominated  by  process  methods  which  depend  upon  case  review 
and,  more  recently,  statistical  displays.  Both  inherent  difficulties  and  an  emphasis 
on  hospital  settings  contributed  to  this  overshadowing  of  outcome  studies. 
Nevertheless,  outcome  evaluation  continues  to  be  recognized  as  an  important,  if 
not  critical,  element  of  medical  care  appraisal  by  most  authorities. 

The  use  of  outcome  evaluation  in  large  scale  medical  care  appraisal  will 
remain  limited  until  simple,  reliable  indicators  of  the  health  of  individuals  and 
populations  become  available.  The  final  effort  of  this  state-of-the-art  paper  will  be 
to  help  define  a  current  role  for  outcome  evaluation. 

Two  general  uses  are  suggested,  consistent  with  the  definitions  developed 
earlier  in  this  paper.  The  first  is  the  critical  task  of  validating  both  the  criteria  and 
methods  used  in  process  evaluation.  This  will  require  careful  health  services 
research,  in  limited  and  controlled  experimental  environments,  to  determine  the 
value  of  current  process  criteria  by  patient  and  process  outcomes.  By  implication, 
it  will  also  require  the  sensitivity  to  modify  process  criteria  promptly  in  response 
to  these  research  findings. 
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The  second  general  use  for  outcome  evaluation,  in  regional  medical  care 
appraisal,  is  to  generate  and  evaluate  regional  norms  for  administrative  and 
economic  outcomes  and  to  utilize  these  norms  for  the  review  of  regional 
performance.  Current  use  of  PAS,  QUEST,  and  HUP  utilization  data  offer 
examples  of  this  usage. 

Three  additional  uses  for  outcome  evaluation  are  appropriate  to  specific 
settings  within  a  regional  medical  care  appraisal  system,  including: 

(1)  monitoring  the  impact  of  health  service  programs  on  defined  target 
populations; 

(2)  evaluating  the  quahty  of  medical  care  in  prepaid  group  practices  with 
stable  populations  for  longitudinal  study; 

(3)  defining  problems  for  process  study,  within  institutions,  by  the 
Williamson  Health  Accounting  strategy. 
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DATA  PROCESSING  SYSTEMS 
FOR  MEDICAL  CARE  APPRAISAL 

by  Paul  A.  Bonner 

I.  INTRODUCTION 

This  paper  is  composed  of  summative,  factual  descriptions  of  major  data 
processing  systems  currently  proposed  or  in  use  for  the  appraisal  of  hospital  and 
ambulatory  care.  Its  intent  is  to  present  the  significant  elements  of  each  system 
description  abstracted  from  previously  published  papers.  No  attempt  was  made  to 
develop  a  critical  analysis  of  the  advantages  and  disadvantages  of  each  system. 
Significant  emphasis  has  been  placed  on  hospital  discharge  abstract  systems,  as 
reported  by  the  well-known  Airiie  House  Conference,  due  to  their  advanced  stage 
of  development  and  use.  Although  less  developed  and  smaller  in  number,  various 
reports  on  major  ambulatory  data  systems  have  been  abstracted.  The  paper 
attempts  to  present  the  reader  with  a  concise  yet  comprehensive  array  of  various 
health  information  systems  that  now  represent  the  current  state-of-the-art. 

A.  MEDICAL  INFORMATION  SYSTEMS  (MIS) 

It  has  been  demonstrated  by  several  studies  that  approximately  one-fourth 
(25  percent)  of  total  hospital  costs  are  incurred  by  information  handling. 
Consequently,  there  is  an  increasing  need  to  incorporate  modern  technology  into 
the  estabUshment  of  more  efficient  hospital  or  medical  information  systems. 

However,  the  implementation  of  a  computerized  medical  information  system 
has  proved  to  be  an  extremely  difficult  process  with  the  possible  exception  of  the 
administrative  areas  of  a  hospital.  This  has  been  evidenced  by  long-term 
commitments  of  large  amounts  of  money  and  by  scarce  medical  and  engineering 
specialists.  To  complicate  this,  there  are  stringent  requirements  for  size,  speed, 
and  reliability  of  hardware,  not  to  mention  the  difficulty  in  defining  and 
standardizing  the  medical  care  process  itself. 

A  medical  information  system  may  be  defined  as  one  that  uses  electronic 
data  processing  and  communications  equipment  to  provide  on-line  processing 
(possibly  with  real-time  response)  for  patient  data  within  one  or  more  medical 
centers,  for  both  inpatient  and  outpatient  services.  A  hospital  information  system 
(HIS)  may  be  defined  as  a  subsystem  of  an  MIS  that  processes  inpatient  medical 
data,  e.g.,  laboratory,  x-ray,  ECG  reports,  etc.  Other  subsystems  of  an  MIS  might 
include  a  laboratory  data  system  which  processes  chnical  laboratory  data  for 
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inpatient  and  outpatient  services  and  a  hospital  administrative  information  system 
which  processes  administrative  and  business  functions,  e.g.,  bed  census,  admission 
procedures,  and  scheduHng. 

Collen  (53)  has  defined  the  objectives  of  an  MIS  as: 

(1)  Communicate  patient  data  from  professionals  providing  medical  care 
(doctors,  nurses,  technicians,  etc.)  into  a  patient's  computer  medical 
record  and  to  other  professionals  (e.g.,  dietician),  and  to  hospital 
services  (e.g.,  radiology). 

(2)  On  demand  or  on  schedule,  communicate  information  from  the 
patient's  computer  medical  record  to  professionals  and  hospital 
services. 

(3)  Establish  files  and  communicate  information  for  scheduling  of  patients, 
personnel,  and  medical  care  services.  Communicate  between  services, 
e.g.,  nurses'  stations  to  radiology. 

(4)  Establish  a  medical  data  base  that  has  a  high  utility  for  medical  services 
for  the  individual  patient  and  physician. 

(5)  Establish  a  medical  data  base  that  can  fulfill  research  objectives  for 
cUnical,  epidemiological  and  health  services  research. 

(6)  Estabhsh  a  data  base  for  business  and  administrative  functions, 
including  projection  of  needs  and  planning  for  services. 

(7)  Improve  cost  containment  and  quality  of  medical  services. 

(8)  Have  capacity  for  (a)  an  increasing  number  of  patients  and  of  doctors 
and  (b)  progressive  expansion  of  the  health  service  system  subcom- 
ponent. 

To  meet  these  objectives  there  are  a  number  of  requirements  which  must  be 
satisfied.  These  include: 

•  General  and  extraordinary  requirements 

•  Personnel 

•  Computer  Record  and  Patient  Identification 
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•  Equipment 

•  Reliability 

•  Control 

•  Utility 

•  Economy 

•  Time  Planning 

In  fostering  the  continued  development  of  an  MIS  the  following  goals  should 
be  recognized  and  supported.  These  include: 

(1)  Determining  an  effective  size  of  regional  computer  centers  for  medical 
information  systems  for  groups  of  cooperating  hospitals  and  health 
service  systems. 

(2)  Determining  a  more  efficient  organization  for  computer  stored, 
continuing  medical  files,  oriented  to  both  patient  care  and  medical 
research. 

(3)  Developing  new,  super-mass  random  access,  storage  files  to  handle  the 
immense  amount  of  medical  data  generated  from  a  community  of 
patients. 

(4)  Developing  more  efficient  and  acceptable  terminals  for  physicians  and 
other  personnel  to  communicate  with  the  computer.  Graphic  displays 
may  become  essential  for  high  density  data  outputs  and  even  pictorial 
displays  may  be  desirable. 

(5)  Developing  improved  communication  systems  for  transmitting  com- 
patible data  between  medical  centers  within  a  region. 

(6)  Developing  means  of  positive  patient  identification  to  be  apphed 
uniformly  throughout  the  country. 

As  can  be  readily  seen,  the  requirements  for  planning  and  implementing  an 
MIS  are  extensive  with  regard  to  capital,  personnel,  and  organization.  In  addition, 
the  requirements  for  high  reliability  and  user  utility  for  real  time  systems 
substantially  increase  hardware  and  software  needs.  The  magnitude  of  an  MIS 
details  the  need  for  carefully  planned  time  phasing  and  modular  implementation. 
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B.  HOSPITAL  INFORMATION  SYSTEMS  (HIS) 


The  generic  category  of  an  HIS  is  quite  broad  and  includes  automated 
information  sources,  data  transformation  and  management  requirements,  and  user 
information  needs  in  a  patient  care  facility.  These  requirements  are  included  in 
such  organizational  elements  as; 


(1) 

Medical  Staff 

(2) 

Admitting 

(3) 

Medical  Records 

(4) 

Nursing  Units 

(5) 

Diagnostic  Services 

(6) 

Therapeutic  Services 

(7) 

Administrative  and  Business  Functions 

(8) 

Support  Operations 

(9) 

Communications 

Each  of  the  above  organizational  elements  generate  and  use  patient 
information.  It  has  been  estimated  that  the  cost  for  patient  record  keeping  and 
information  handling  averages  $20/patient  day  (261).  Motivation  for  the 
development  of  an  HIS  has  been  described  as  being  two-fold: 

(1)  The  cost  and  information  handhng  could  be  considerably  reduced,  and 

(2)  Improvements  in  patient  management  should  result  from  having  more 
information  immediately  available,  from  both  medical  and  administra- 
tive viewpoints. 

The  broad  system  for  computer-based  medical  information  management  in  a 
health  care  institution  should  be  directed  to  the  problems  of  patient  management 
and  directly  serve  the  tasks  of  patient  care  administration,  i.e.,  diagnosis  and 
therapy.  Basic  to  meeting  those  demands  are  the  problems  of  collecting,  storing, 
transforming,  and  displaying  basic  data  on  command.  As  a  consequence,  efforts  to 
design  and  implement  data  management  systems  have  frequently  (and  appropri- 
ately) been  specific  task  oriented  where  the  output  data  as  well  as  the  problem 
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have  been  well  defined.  A  viable  HIS  is  logically,  then,  a  conglomeration  of 
relatively  discrete  information  subsystems. 

These  discrete  subsystems  must  be  integrated  into  a  smooth  information 
handling  capability  with  capacity  to  correlate  and  collate  as  much  information 
from  each  subsystem  to  provide  a  comprehensive  view  of  medical/administrative 
patterns  and  problems.  An  HIS  must  primarily  contain  the  patient  record  and 
must  acquire,  organize  and  retrieve  these  data  upon  command.  Current  records 
are  usually  stored  in  high-speed  memory  in  a  central  data  bank  (computer)  to 
allow  recalling  and  updating  from  remote  terminals  in  a  short  period  of  time. 
These  terminals  can  be  distinguished  not  only  by  appropriate  hardware  but  also 
by  which  programs  can  be  accessed  to  process  data  in  the  central  bank. 

Since  the  modem  hospital  is  not  a  single  homogeneous  activity,  it  has  been 
recognized  that  the  development  of  different  but  intertwined  subsystems  will 
occur  at  differential  rates.  Consequently,  this  differential  awareness  of  the  need  to 
automate  has  militated  against  the  development  of  a  total  HIS. 

C.  STATEWIDE/REGIONAL  MEDICAL  INFORMATION  SYSTEMS 

Statewide  or  regional  medical  information  systems  have  been  widely 
discussed  for  the  past  two  decades  with  concepts  markedly  being  altered  during 
this  period.  In  light  of  the  variety  of  viewpoints,  it  is  worthwhile  to  examine 
recently  proposed  alternatives,  problems,  and  reasons  for  the  lack  of  any  current 
statewide  or  regional  systems. 

Ideally,  an  MIS  should  be  comprised  of  individual  subsystems,  e.g.,  hospital 
and  nursing  home  record  systems,  outpatient  records,  office  records,  etc.  (53). 
Professional  participants  of  such  conceptual  ventures  have  been  cautious  about 
this  type  of  centralized  planning.  Preferences  have  rested  with  the  ability  and 
right  to  adapt  information  systems  to  local  strengths  and  needs.  In  addition,  very 
few  efforts  to  develop  even  small  subsystems  have  succeeded.  Of  the  small 
number  that  have  succeeded  in  any  one  institution,  even  less  have  grown  into 
other  institutions  and  these  subsystems  deal  solely  with  hospital  practice.  The 
concept  of  a  true  statewide  or  regional  MIS  will  involve  coordinated  data 
collection  and  use  by  various  types  of  health  care  providers  and  users. 

To  establish  a  statewide  MIS,  listing  of  practitioner,  facilities,  utilization  and 
actual  patient  records  would  have  to  be  generated  from  general  hospitals, 
outpatient  clinics,  physicians'  offices,  and  medical  records  from  specialized 
facilities  such  as  V.A.  hospitals,  mental  health  institutions,  infectious  disease 
institutions,  cancer  hospitals,  nursing  homes,  convalescent  facilities,  VNA  services 
and  drug  retailers.  Only  this  set  of  providers,  at  a  minimum,  would  provide  a 
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picture  of  the  true  cost  of  illness  versus  hospital  costs  as  well  as  a  picture  of  the 
way  in  which  patients  are  able  or  the  reasons  why  patients  are  unable  to  obtain 
care. 

To  say  the  least,  the  formation  of  such  a  network  will  require  enthusiastic 
participation  of  various  private,  and  quasi-private  institutions;  substantial  develop- 
ment and  operating  costs;  solution  of  complex  technical  obstacles,  and  successful 
resolution  of  probing  social  questions.  In  the  past,  medical  planners  have  tended 
to  under-emphasize  or  ignore  the  social  impHcations  or  interface  with  the  public 
associated  with  a  statewide  MIS.  Having  chosen  to  avoid  those  fundamental  issues 
and  problems,  the  "constituency"  of  such  a  system  still  remains  within  the  inner 
circle  of  "computemiks." 

Lindberg  (53)  has  attempted  to  identify  the  reasons  for  the  initial  lack  of 
statewide  information  systems  under  two  main  headings:  social  and  technological. 

( 1 )  Social  Questions 

(a)  Purpose 

(b)  Privacy 

(c)  Depersonalization 

(d)  Cost 

(2)  Technical  Problems 

(a)  Patient  Identification 

(b)  Lack  of  Uniform  Terminology 

(c)  Large  Data  Files 

(d)  Reliability  and  Failures 

(e)  Costs  of  Data  Transmission 

In  addition  to  the  social  and  technological  issues  raised  by  Lindberg,  there 
also  remains  the  question  of  the  network  equipment  configuration.  Current 
thinking  has  centered  around  a  conceptual  model  of  a  hypothetical  large 
computer  which  is  dedicated  to  numerous  stations  connected  to  it.  Peripheral 
computers  could  also  be  placed  in  these  networks  to  concentrate  messages. 
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process  entry  data,  and  switch  messages.  Alternative  conceptual  models  deal  with 
the  use  of  medium-sized  computers  which  could  be  dedicated  to  a  single  function 
of  a  subsystem;  and  each  by  a  suitable  transmission  system,  could  serve  all  the 
stations.  Typical  functions  would  be:  admission/discharge /census;  automated 
patient  history;  interpretation  of  physiological  signals;  bloodbank  management, 
general  laboratory  data  transmission;  diagnosis  assistance;  analysis  of  patient  care; 
patient  scheduling;  and  special  procedures.  Although  the  conceptual  issues  of  such 
a  system  have  been  debated  at  length,  a  total  operational  model  is  far  from 
implementation. 

This  section  of  the  paper  has  primarily  addressed  the  generic  definitions  of 
an  MIS.  The  next  section  discusses  various  current,  operational  hospital  discharge 
data  systems. 

II.  HOSPITAL  DISCHARGE  DATA  SYSTEMS 
A.  PURPOSE 

On  June  18-20,  1969,  a  Conference  on  Hospital  Discharge  Abstract  Systems 
was  held  at  Airhe  House,  Warrenton,  Virginia  (180).  Its  purpose  was  to  explore 
ways  for  improving  and  coordinating  health  information  systems  in  the  United 
States.  The  sponsors  of  the  Conference  were  The  Johns  Hopkins  University,  the 
National  Center  for  Health  Statistics,  and  the  National  Center  for  Health  Services 
Research  and  Development.  These  organizations  were  fully  cognizant  of  the  fact 
that  there  was  urgent  need  for  the  development  of  uniform  health  data  systems 
that  could  link  a  variety  of  elements  and  provide  an  adequate  basis  for 
comparison,  evaluation,  planning,  and  poUcy-making. 

For  a  host  of  reasons,  some  of  which  were  alluded  to  in  the  previous  section, 
hospital  discharge  data  appeared  to  be  the  logical  starting  point  for  the 
development  of  a  uniform  health  data  system.  Conceptual  issues  addressed  the  use 
of  hospital  statistics  as  a  measure  of  controlling  costs  and  monitoring  the  quality 
of  care.  In  relation  to  controlling  cost,  it  is  difficult  to  comprehend  how  effective 
measures  can  be  used,  until  it  is  possible  to  link  patient  care  data,  administrative 
data,  and  financial  data,  so  that  utilization,  services,  and  charges  can  be  compared 
within  and  among  hospitals. 

In  relation  to  the  quality  of  care,  there  has  been  growing  concern  about  this 
area  on  the  part  of  many  professional  groups,  e.g.,  Regional  Medical  Programs, 
continuing  medical  education  programs,  and  new  peer  review  organizations.  The 
concept  of  the  hospital  being  a  self-contained  unit  has  shifted  to  that  of  being  the 
focal  point  of  health  care  for  the  community.  Planning  agencies  as  well  as  public 
and  private  health  insurers  have  also  been  well  aware  of  the  need  for  better  and 
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more  uniform  statistics.  The  expanding  interest  and  spending  in  health  care  by  the 
Federal  Government  has  stimulated  the  necessity  of  hospital  data,  e.g.,  Medicare 
and  Medicaid.  Legislation  under  the  Hill-Burton  and  Comprehensive  Health 
Planning  Acts  have  placed  new  requirements  for  a  variety  of  hospital  and  health 
related  data  with  the  growing  demand  for  health  statistics  and  the  concurrent 
development  of  computer  science.  It  is  now  possible  to  collect,  collate,  store, 
analyze,  and  distribute  data  on  a  much  more  elaborate  and  sophisticated  scale. 

As  a  result  of  these  many  factors,  there  has  been  a  tremendous  increase  in 
the  activity  of  hospital  data  systems.  The  field  is  embarking  on  a  formative  period 
of  development  and  change,  with  new  systems  being  developed  and  new 
techniques  introduced.  This  paper  will  deal  mainly  with  hospital  discharge 
abstract  systems  since  there  is  far  more  documentation  available  than  for  existing 
ambulatory  record  systems.  Several  operational  ambulatory  data  systems  will  be 
discussed  later.  Hospital  records  have  traditionally  provided  the  "hardest"  data 
continuously  available  on  morbidity.  These  data  are  easier  to  collect  and  codify 
than  those  from  a  physician's  office.  Hospitalization  is  a  measurable  episode,  and 
diagnosis  and  other  parameters  are  routinely  recorded. 

There  are  limitations  to  collection  and  use  of  hospital  data  that  must  be 
taken  into  consideration,  especially  in  relation  to  total  health  care  information. 
One  must  remember  that  hospital  morbidity  statistics  may  be  biased;  that  hospital 
care  is  only  one  part  of  the  total  health  care  setting;  and,  that  hospital  utilization 
rates  are  influenced  by  factors  other  than  severity  of  illness,  such  as  socio- 
economic level,  local  customs,  availability  of  beds,  convenience,  and  the  presence 
or  absence  of  financial  barriers.  Ideally,  the  ultimate  expansion  of  a  health  data 
system  should  include  outpatient  clinics,  nursing  homes,  physician's  offices,  home 
care  programs,  and  other  settings  that  encompass  the  total  range  of  health 
services.  The  long-range  objective  should  be  geared  to  a  network  of  integrated 
reporting  systems  covering  all  aspects  of  medical  care.  Hospital  data,  on  the  other 
hand,  should  be  related  to  defined  population  or  denominators  which  can 
maximize  its  value  by  correlating  them  with  health  services  information  from 
other  sources. 

This  and  succeeding  sections  of  the  paper  are  predominantly  based  on  the 
results  of  the  Airlie  House  Conference  and  attempt  to  provide  summative  abstracts 
of  various  hospital  discharge  data  systems  as  well  as  a  codification  of  pertinent 
recommendations  for  future  implementation  and  use.  The  abstracts  not  only 
include  independent  non-profit  data  systems  such  as  the  Professional  Activity 
Study  (PAS)  and  federal  systems  such  as  the  National  Hospital  Discharge  Survey  by 
the  National  Center  for  Health  Statistics,  but  also  data  collected  by  public  and 
private  insurance  agencies  such  as  the  Social  Security  Administration  (MADOC) 
and  the  Blue  Cross  Association. 
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Of  the  independent  non-profit  systems,  PAS  is  the  largest  and  is  the  only  one 
with  a  national  scope.  It  began  in  1953  and  as  of  1970,  1,300  hospitals  in  46 
states  and  Canada  were  members,  which  represents  approximately  30  percent  of 
the  discharges  from  short-term  general  hospitals  in  the  two  countries.  In  addition, 
more  than  one-half  of  the  hospitals  participate  in  the  Medical  Audit  Program 
(MAP)  which  was  added  in  1959  to  aid  hospital  medical  staffs  in  the  evaluation  of 
quality  care.  Most  hospitals,  other  than  the  participants  in  MAP,  do  not  record 
clinical  data  in  the  same  detail. 

The  Hospital  UtUization  Project  (HUP),  QUEST  of  Northeast  Ohio,  Health 
Service  Data  of  Wisconsin,  Inc.  (HSD-W),  and  the  Cahfomia  Health  Data 
Corporation  (CHDC),  are  smaller,  regional  systems.  Two  recent  systems  also 
deserve  mention;  namely,  the  Utihzation  Information  Service  (UIS)  of  the 
Massachusetts  Hospital  Association  and  the  Connecticut  Utilization  and  Patient 
Information  System  (CUPIS).  There  are  also  several  commercial  firms  such  as 
Medi-Record,  Medinet,  Medi-Data,  etc.,  that  process  data  for  hospitals  on  an 
individual,  tailor-made  basis.  They  do  not  presently  contribute  to  the  general  pool 
of  health  information  except  indirectly  through  the  relatively  small  number  of 
subscribing  hospitals.  They  are,  however,  a  potential  resource  in  addition  to  the 
non-profit  systems  for  expansion  of  the  network  of  reporting  systems  in  this 
country. 

Since  the  majority  of  American  hospitals  do  not  participate  in  organized 
data  systems,  the  National  Hospital  Discharge  Survey  is  able  to  provide  a  service 
by  being  the  principal  source  of  national  statistics.  Main  drawbacks,  however,  are 
that  the  items  collected  by  the  survey  are  limited  and  the  small  sample  size  (one 
percent  of  all  annual  short-term  hospital  discharges)  does  not  permit  regional  or 
local  breakdowns. 

Another  source  of  health  data  is  insurance  claims  forms.  They  offer  the 
advantage  of  continuing  vital  financial  information  of  a  patient's  hospital  stay 
which  is  not  usually  available  from  other  previously  mentioned  sources.  They  are, 
however,  lean  on  medical  and  socio-demographic  information,  and  since  most  keep 
claims  data  on  a  contract  basis,  it  is  extremely  difficult  to  identify  a 
population-at-risk.  One  possible  exception  is  the  Medicare  program,  which  collects 
more  data  on  patients  than  most  private  carriers  and  illustrates  how  a  claims  form, 
with  some  alteration,  might  serve  as  a  hospital  discharge  abstract. 

A  further  concern  voiced  at  the  Conference  was  the  data  requirements  of 
various  categories  of  users  ( 1 80). 
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These  categories  include: 


(1)  Hospital   management  (internal  planning,  accreditation,  utilization 
review,  and  legal  requirements). 

(2)  Clinical  management  (medical  audit,  continuing  medical  and  health 
professional  education). 

(3)  Fiscal  accounting  (cost  control,  condition  of  third-party  payers). 

(4)  Community  planning. 

(5)  Epidemiologic  and  health  services  delivery  research. 

The  following  sub-sections  will  address  the  various  major  health  data  systems 
and  their  potential  use. 

B.  MAJOR  HOSPITAL  DISCHARGE  ABSTRACT  SYSTEMS 

1 .  Professional  Activity  Study  (238) 

The  Commission  on  Professional  and  Hospital  Activities  (CPHA)  is  a 
non-profit  corporation  sponsored  by  the  American  College  of  Physicians, 
American  College  of  Surgeons,  American  Hospital  Association,  and  the  South- 
western Michigan  Hospital  Council.  The  Professional  Activity  Study  (PAS)  is  one 
specific  program  of  CPHA  which  was  developed  in  1953  under  P.K.  Kellogg 
Foundation  grants.  In  addition  to  PAS,  MAP,  and  the  Length  of  Stay  Package,  the 
Commission  also  operates  the  Cancer  Registry  Information  System  and  the 
Community  Health  Information  System.  The  Commission  also  conducts  research 
on  disease  and  therapy  classifications  and  on  medical  and  health  information.  It 
collaborated  with  the  U.S.  Pubhc  Health  Service  on  the  publication  of  the  first 
ICDA,  its  revision,  and  published  the  hospital  adaptation  of  ICDA  (H-ICDA). 

The  primary  purpose  of  PAS  is  to  provide  displays  of  information  derived 
from  the  medical  records  of  hospital  inpatients  for  use  by  hospital  administrative 
and  medical  staffs  of  subscribing  hospitals.  Another  purpose  is  to  collect  and 
maintain  a  computer  retrieval  file  of  accumulated  PAS  data  which  CPHA  can  use 
for  its  own  studies.  A  PAS  case  abstract  is  prepared  by  the  medical  record 
department  of  each  subscribing  hospital  for  every  discharge,  including  newborns 
and  stillboms.  The  abstract  also  allows  space  for  optional  data  which  may  be 
introduced  at  the  hospital's  discretion.  The  case  abstracts  are  sent  to  CPHA  in 
batches  for  rapid  processing.  Hospital  participation  is  voluntary. 
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All  data  are  processed  by  Honeywell  digital  computers  with  entry  by 
punched  cards.  Routine  tabulation  and  reporting  to  subscribing  hospitals  occurs 
in  three  cycles:  monthly,  quarterly,  and  semiannually.  Hospitals  participating  in 
the  Medical  Audit  Program  (MAP)  receive  additional  reports  on  a  quarterly  basis. 
For  hospitals  subscribing  to  the  Length  of  Stay  Package,  PAS  has  created  a  model 
hospital  of  average  patients  similar  to  those  actually  treated.  These  average 
patients  are  described  in  a  base  table  compiled  from  all  short-term  general  hospital 
discharges  in  the  U.S.  who  subscribe  to  PAS.  The  base  table  uses  200  diagnostic 
groupings,  five  age  groupings,  the  presence  or  absence  of  secondary  diagnoses,  and 
the  presence  or  absence  of  surgery.  Hospitals  are  also  provided  with  custom 
tabulations  of  their  own  data  as  well  as  inter-hospital  comparisons  according  to 
their  own  specifications. 

The  data  base  for  PAS  includes: 

•  Patient  Identification 

•  Social  Characteristics 

•  Diagnoses 

•  Operations 

•  Selected  Admission  Findings 

•  Investigations  (total  work-up) 

•  Management  (therapy) 

•  Optional  Data 

The  PAS  case  abstracts  are  considered  to  be  reasonably  accurate  reflections 
of  the  clinical  records  submitted.  Accuracy  can  vary  and  is  dependent  on  the  case 
abstract  item.  Items  such  as  patient  identification,  age,  sex,  physician,  surgeon, 
admission  date,  discharge  date,  discharge  status,  one  diagnosis  and  one  operation, 
birth  weight,  areas  of  investigation  and  management  can  be  readily  and  accurately 
extracted  by  the  record  abstractor.  Other  items,  such  as  emergency  admission, 
must  emphasize  variations  in  local  definition. 

When  hospitals  first  begin  participation  in  PAS,  all  incoming  case  abstracts 
are  monitored  by  experienced  CPHA  coders.  As  PAS  hospitals  achieve  mastery  of 
completion  of  the  form  as  well  as  the  H-ICDA  coding  of  diagnoses  and  operations, 
the  monitoring  is  transferred  to  keypunch  and  verifier  operators  who  also  edit 
during  this  process.  There  are  also  editing  routines  automatically  applied  by  the 
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computer.  There  are,  however,  certain  kinds  of  errors  which  can  never  be  detected 
on  a  single  case  abstract  and  can  only  be  discovered  by  review  of  statistics 
developed  from  the  individual  abstracts.  If  inconsistencies  are  detected  by  CPHA 
staff,  they  are  called  to  the  attention  of  the  participating  hospital.  In  addition,  if  a 
participating  hospital  does  not  maintain  a  low  rate  of  coding  errors  which  can  be 
detected  by  CPHA,  it  is  dropped  from  the  program. 

PAS  has  been  designed  to  increase  the  accessibility  of  medical  record 
information  for  monitoring  and  improving  patient  care.  The  reports  generated  are 
designed  to  help  hospitals  and  medical  staffs  in  the  following  areas: 

•  Peer  review 

•  Practice  pattern  analysis 

•  Medical  auditing 

•  Continuing  medical  staff  education 

•  Utilization  review 

•  Medical  staff  committee  work 

•  Inter-hospital  comparisons 

•  Medical  record  quality 

•  Medical  record  indices 

•  Base  patients  statistics 

In  an  effort  to  maintain  the  accuracy  and  quality  of  case  abstracting,  CPHA 
sponsors  training  programs  for  physicians,  administrators,  and  record  room 
administrators  of  participating  hospitals.  The  training  sessions  are  conducted  in 
Ann  Arbor  for  a  duration  of  two  days  each.  In  addition,  one-day  schools  are 
conducted  at  strategic  points  throughout  the  country  to  further  extend  the  arm 
of  CPHA. 

The  major  advantages  and  disadvantages  expressed  by  users  of  the  system 

are: 
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Advantages 

•  Simplicity  of  the  format  of  a  uniform  case  abstract. 

•  .  Continued  system  development  and  refinement,  research,  and  educa- 

tional activity. 

•  Large  data  bank  of  standardized  information  in  computer-accessible 
form. 

Disadvantages 

•  Clinical  researches  require  more  detail  including  medical  history  and 
physical  findings  with  specific  clinical  laboratory  and  X-ray 
interpretations. 

•  Data  is  specific  to  hospitalized  populations  rather  than  community 
populations. 

•  Episodic  nature  of  data  in  reporting  an  illness. 

PAS  information  has  been  useful  in  studies  conducted  by  the  CPHA, 
independent  research  investigators,  Regional  Medical  Programs,  and  comprehen- 
sive health  planning  agencies.  For  example,  CPHA  has  conducted  studies  dealing 
with  evaluation  of  medical  practice,  length  of  stay  analyses,  studies  of  methods 
and  treatment  of  diagnoses,  laboratory  and  X-ray  utilization,  and  profiles  of  the 
management  of  selected  groups  of  patients  or  procedures.  Other  studies  by 
independent  researchers  include  therapeutic  abortions  in  the  United  States, 
statistical  tables  by  hospitals  and  by  diagnoses  for  a  cohort  of  hospitals  over  a 
five-year  period,  and  special  studies  identifying  areas  of  need  for  physician 
education.  Arrangements  have  been  made  with  the  California  Health  Data 
Corporation  (CHDC)  to  supply  raw  data  on  magnetic  tape  from  those  hospitals  in 
PAS  desiring  their  data  to  be  included  in  CHDC  studies.  PAS  has  assisted  the 
National  Center  for  Chronic  Disease  Control  in  providing  a  format  for  projecting 
acute  myocardial  infarctions  on  national  basis.  CPHA  has  also  tabulated  data  on 
cardiovascular  disease  and  cancer  for  the  Community  Health  Service.  Also, 
profiles  of  hospitalization  of  psychiatric  patients  and  short-term  general  hospitals 
for  pre-  and  post-Medicare  periods  were  provided  to  the  Social  Security 
Administration. 
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2.  Quality,  Utilization,  Effectiveness  Statistically  Tabulated  (QUEST)  Program 
of  Northeast  Ohio  (160) 


In  1956,  the  Citizens  Hospital  Physician  Study,  with  22  representatives  from 
the  public,  management,  labor,  physicians,  hospitals,  and  Blue  Cross,  was 
established  to  study  hospital  costs  and  utilization  in  five  countries  of  Northeast 
Ohio.  The  purpose  of  the  study  was  to  examine  certain  data  on  individual 
inpatient  discharges  during  a  three-month  period  from  all  hospitals  in  the  area. 
The  study  included  facts  on  over  63,000  inpatients  who  received  an  estimated 
500,000  days  of  care. 

A  committee  published  a  14-chapter  report  dealing  with  the  many  aspects  of 
hospital  operation,  which  has  been  used  not  only  in  Northeast  Ohio,  but 
throughout  the  country  and  still  serves  as  an  important  planning  document  for 
the  Northeast  Ohio  area.  However,  the  citizens  committee  recognized  that  their 
report,  which  was  limited  to  care  during  the  three-month  period  in  1957,  would 
soon  become  outdated.  One  of  their  major  and  most  lasting  recommendations  was 
that  fact-finding  studies  of  hospital  costs,  hospital  utilization,  hospital  operation, 
and  for  hospital  facilities  be  done  on  a  continuing  basis. 

After  the  publication  of  the  report,  four  hospitals  in  Cleveland  requested 
Blue  Cross  to  make  available  a  data  processing  staff  and  equipment  for  the 
continuous  compilation  of  facts  regarding  inpatient  care.  Blue  Cross  agreed,  with 
the  condition  that  the  four  hospitals  design  a  system  of  uniform  data  to  be 
collected  and  reported.  A  research  committee  of  hospital  administrators  and 
subsequently  a  research  committee  of  medical  records  librarians  were  organized  to 
spearhead  and  monitor  the  program.  Two  additional  research  committees  were 
established  in  1965;  namely,  physicians  and  hospital  trustees. 

The  pilot  program  drafted  by  the  committee  of  hospital  administrators  was 
implemented  in  one  hospital  during  May  1958.  The  program  justified  expansion. 
During  the  test  period  as  of  July  1,  1958,  the  four  original  hospitals  were 
participating.  Since  that  time,  the  number  of  hospitals  participating  has  increased 
to  53.  This  represents  97  percent  of  the  general  hospital  beds  and  corresponding 
percentage  of  discharges  in  the  ten  counties  of  Northeast  Ohio.  In  addition,  the 
program  now  is  processing  over  30  percent  of  all  general  hospital  inpatient 
discharges  for  the  state. 

Since  1967,  this  program  has  been  known  as  QUEST  which  refers  to  Quality, 
Utilization,  Effectiveness,  Statistically  Tabulated.  The  purposes  of  the  program 
are: 

•      Provision  of  data  for  use  by  hospital  administration  and  medical  staff  in 
studies  of  hospital  utilization. 
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•  Provision  of  data  for  review  of  patient  care  by  the  medical  review  and 
surgical  tissue  committees  of  the  hospital. 

•  Provision  of  data  for  medical  research. 

•  Provision  of  data  for  planning  by  CHP  organizations,  RMP,  mental 
health  agencies,  and  Neighborhood  Health  Centers. 

•  Provision  of  general  statistical  data  for  use  by  hospital  administration. 

•  Provision  of  data  for  physician  applicants  to  medical  specialty  boards. 

•  Provision  of  physician  rosters  by  hospital  staff  appointment,  specialty 
and  office  location  as  well  as  alphabetical  rosters. 

•  Provision  of  factual  data  for  the  completion  of  reports  to  the  State 
Health  Departments,  American  Medical  Association,  American  Hospital 
Association,  and  a  Joint  Commission  for  Accreditation  of  Hospitals. 

The  program  originally  consisted  of  only  one  part  in  1958  which  provided  an 
analysis  of  several  aspects  of  hospital  utiHzation  or  the  volumetrics  of  inpatient 
care.  This  part  corresponded  to  data  routinely  collected  by  hospital  medical 
record  departments.  The  program  improved  this  routine  collection  function  by 
implementing  a  fact  sheet  or  abstract  form  which  was  transmitted  to  Blue  Cross 
and  served  as  the  basis  for  the  reports  produced  by  the  computer.  Part  II  was 
instituted  in  1963  and  consisted  of  an  analysis  of  inpatient  discharges  by  diagnosis 
and  by  surgical  operations.  ICDA  codes  are  used  in  compiling  the  diagnostic  and 
surgical  indices.  Of  the  53  hospitals  participating  in  Part  I,  there  are  51 
participating  in  Part  II. 

In  July  1967,  the  Research  Committee  of  Physicians  developed  Part  III 
which  is  designed  to  assist  medical  staff  interested  in  reviewing  the  quality  of 
inpatient  care.  The  Part  III  report  is  furnished  to  the  hospitals  for  use  by  the 
medical  review  committee  which  lists  patient  discharges  by  diagnosis  together 
with  surgical  operations  performed  and  a  record  of  certain  clinical  findings  and 
the  diagnostic  and  therapeutic  procedures  instituted.  A  corresponding  report  is 
furnished  with  listings  by  attending  physician.  The  Regional  Medical  Program  of 
Northeast  Ohio  and  its  committees  on  heart,  cancer,  and  resporatory  diseases  also 
expressed  interested  in  the  development  of  profiles  by  ICDA  diagnostic  code. 
These  profiles  were  subsequently  furnished  to  medical  review  committees  of 
hospitals  for  assistance  in  reviewing  records  in  Part  III  of  the  QUEST  program. 
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The  abstract  forms  are  completed  by  the  hospital  medical  records  depart- 
ment for  each  discharged  patient.  The  time  requirement  to  complete  the  abstract 
is  estimated  at  two  minutes  for  Part  I,  two  minutes  for  Part  II,  and  three  minutes 
for  Part  III.  It  is  assumed  that  there  is  a  substantial  savings  of  time  over  what  is 
required  to  record  the  data  manually  and  additional  time  savings  through  the  use 
of  electronic  data  processing  for  the  tabulation  of  the  data. 

Reports  are  furnished  monthly,  bi-monthly,  and  annually  to  participating 
hospitals.  A  description  of  the  reports  follows. 

Monthly  Reports 

•  Discharge  Journal 

This  report  lists  all  patients  discharged  by  the  hospital  from  a  specific 
month  and  serves  a  number  of  purposes.  It  serves  as  a  control  log  of  the 
number  of  inpatient  discharges  with  patients  listed  chronologically  by 
day  of  discharge  and  within  day  of  discharge  by  patient  number.  All  the 
discharge  data  on  each  abstract  sheet  are  listed  for  each  patient.  Totals 
for  each  day  are  shown  on  the  number  of  patients  discharged,  the 
number  of  newborn,  and  the  number  of  other  than  newborn,  the  total 
number  of  patient  days  for  patient  discharge,  and  the  number  of 
consultations  for  discharged  patients.  There  are  also  monthly  totals  of 
patients  by  race  and  by  religion  included  in  the  discharge  journal 
together  with  monthly  totals  for  the  same  items  as  daily  totals.  The 
number  of  cases  and  days  in  the  current  six-month  period  or  any  prior 
period  are  also  included  in  this  report.  These  figures  are  shown  for 
newborn.  Medicare,  and  total  days  and  cases,  and  apply  to  cases 
discharged  on  a  specific  month  for  which  the  discharge  journal  is 
produced. 

•  Financial  Classification 

This  report  tabulates  the  number  of  patients  and  patient  days  by 
financial  classification  and  mode  of  payment  whether  self-pay  or 
third-party.  There  are  separate  totals  for  both  patients  and  days  of  care 
for  newborn,  adult,  and  children  and  total. 

•  Postal  Zone  of  Geographic  Area 

This  listing  shows  a  tabulation  of  the  number  of  patients  and  days  of 
care  by  postal  zone  and  other  areas  of  the  patient's  home  address. 
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•     Discharge  Analysis  by  Service 


This  is  a  tabulation  of  the  number  of  patients  by  discharge  service 
(medicine,  surgery,  obstetrics,  newborn,  etc.).  The  number  of  male  and 
female  patients  by  medical  service  in  each  of  the  three  broad  age  groups 
(13  years  and  under,  14  to  64  years,  65  years  and  older)  is  also  shown 
in  this  report.  Patient  days  by  service  for  each  of  the  three  age  groups 
are  also  Hsted  in  this  report.  Patient  deaths  are  also  listed  and  are 
tabulated  by  the  number  who  died  within  48  hours  of  admission  or 
after,  and  by  the  number  within  these  categories  who  did  not  undergo  a 
post-mortum  examination.  Consultations  for  patients  in  each  discharge 
service  are  also  tabulated. 

•  Physicians  Index 

This  index  is  a  tabulation  by  attending  physician  of  the  number  of 
patients  he  attended  and  were  discharged  during  the  reporting  month. 
The  total  number  of  patient  days  and  the  number  of  patients  who  died 
are  also  shown  by  attending  physician.  The  number  of  patient  days,  the 
discharge  status  (aUve  or  expired),  patient  number,  the  discharge  date, 
the  financial  class,  and  postal  zone  or  area  of  home  address  are  shown 
individually  for  each  patient.  Information  is  included  in  this  report  on 
the  number  of  patients  and  patient  days  for  cases  which  stayed  two 
days  or  less  or  thirty  days  or  more. 

•  Consulting  Physicians '  Index 

This  report  shows  those  cases  on  which  a  written  consultation  was  done 
by  each  physician.  The  total  number  of  such  consultations  given  by 
each  physician  in  relation  to  patients  discharged  during  the  month  are 
listed.  Data  on  individual  patients  are  similar  to  those  in  the  physician 
index.  The  only  exceptions  are  the  replacements  of  the  number  of 
patient  days  and  the  discharge  status  by  the  service  requesting  and  the 
service  giving  the  consultation. 

•  Service  Requesting  Consultation 

This  report  tabulates  the  number  of  consultations  requested  by  each 
service  and  within  each  requesting  service,  it  lists  the  number  of 
consultations  given  by  each  service. 
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•     Service  Giving  Consultations 


This  provides  a  tabulation  of  the  number  of  consultations  given  by  each 
service  to  all  other  services. 

Bi-Monthly  Reports 

•  Diagnostic  Index 

This  report  lists  in  order  by  ICDA  code  each  case  which  has  received 
care  at  a  particular  hospital  for  a  specific  period.  It  serves  as  a 
cross-index  since  cases  are  listed  under  each  diagnostic  code  which 
apply  to  the  case.  A  total  is  given  for  each  diagnosis  for  the  number  of 
cases  by  primary  diagnosis  and  the  number  of  days  of  care  for  these 
cases.  Totals  are  shown  for  all  cases  whether  evidenced  by  a  primary  or 
secondary  diagnosis.  Indices  are  cumulative  up  to  a  year  with 
supplement  indices  provided  for  late  reported  cases.  Each  case  has  the 
following  items  hsted:  applicable  diagnostic  codes,  patient  number, 
discharge  date,  sex  and  race,  age,  attending  physician,  discharge  status, 
number  of  days  stay,  financial  class,  all  applicable  operation  codes  and 
surgeons  who  performed  operations. 

•  Operations  Index 

This  report  is  similar  to  the  diagnostic  index  and  reports  the  number  of 
surgical  operations  by  ICDA  code.  Cases  are  listed  individually  by 
surgical  operation  code,  and  are  cumulative  for  a  calendar  year. 

•  Patient  Care  Report 

This  report  is  generated  for  the  use  by  medical  review  and  utilization 
review  committees  of  the  hospital  medical  staffs.  Patients  are  listed  by 
diagnostic  index  with  additional  data  on  admitting  diagnosis,  the 
primary  surgical  operation,  admission  findings,  laboratory  findings, 
type  of  X-ray  service  performed,  blood  therapy,  and  any  other  therapy. 

•  Patient  Care  Report 

This  report  is  basically  the  same  as  the  patient  care  report  except  that 
the  listing  is  by  attending  physician. 
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Annual  Reports 

Annual  summaries  by  diagnosis,  surgical  operation,  geographic  area,  financial 
class,  medical  service,  and  attending  physician  are  generated  for  each  hospital. 
Consideration  has  been  given  to  extending  QUEST  to  include  outpatients, 
patients  and  extended  care  facilities,  and  nursing  homes  and  home  care  patients. 
It  is  important  to  note  that  this  reflects  the  growth  of  hospital  outpatient  services 
and  hospital  affiliation  with  extended  care  facilities,  nursing  homes  and  home  care 
programs  and  the  continuing  importance  of  monitoring  the  continuity  of  care 
rendered  to  patients. 

Quarterly  Cost  Reports 

During  the  past  several  years,  QUEST  has  inaugurated  a  program  of  cost 
analysis  and  comparison.  It  was  decided  to  establish  a  quarterly  comparison  of  the 
cost  of  all  hospitals  in  Northeast  Ohio  within  six  groups  cateogrized  by  geographic 
location  and  size.  Cost  comparisons  are  made  on  the  basis  of  the  AHA 
classification  of  expense  accounts  and  costs  are  codified  into  five  categories: 
inpatient  costs,  outpatient  clinic  costs,  emergency  room  costs,  ambulatory 
surgery,  and  referred  ambulatory  patient  costs. 

Detailed  analyses  of  quarterly  hospital  costs  can  aid  in  the  development  of 
incentive  hospital  reimbursement.  While  present  incentive  factors  in  the  reim- 
bursement formula  are  based  on  gross  cost  of  all  hospitals,  these  quarterly  cost 
analyses  make  it  possible  to  determine  the  advisability  of  a  separate  formula  for 
each  of  the  six  groups  of  hospitals  and  five  categories  of  patients.  It  also  allows 
comparison  of  functional  costs  within  the  hospitals  to  gross  per  capita  per  diem 
costs. 

The  major  overriding  success  factor  of  the  QUEST  program  is  that  it  has 
resulted  from  major  cooperation  of  hospitals  and  physicians.  This  regional 
cooperative  computer  program  has  several  advantages: 

•  Permits  local  comparison  of  hospitals  of  similar  nature  when  these 
hospitals  agree  to  participate. 

•  Permits  maximum  control  of  input  into  the  system  because  of  hospital 
proximity  to  a  cooperative  computer  system. 

•  Permits  flexibility  within  the  system. 

•  Permits  analysis  of  the  volumetrics  of  care  for  a  denominator 
population. 
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Since  the  QUEST  system  is  designed  to  permit  expansion,  it  may  be  possible 
to  include: 

•  Health  data  on  ambulatory  patients,  nursing  home  patients,  and  home 
care  patients. 

•  Admission  data  and  financial  data  with  emphasis  on  patient  account 
data. 

QUEST  also  has  definite  advantages  for  the  provider.  They  include: 

•  Design  to  eliminate  duplication  of  hospital  records. 

•  Regional  cooperation  eliminates  duplication  in  cost  of  manpower  and 
hardware  inherent  in  individual  hospital  systems. 

•  Permits  small  hospitals  to  join  in  an  automated  data  processing 
program. 

•  Permits  maximum  use  of  the  central  dedicated  computer. 

The  medical  profession  in  Northeast  Ohio  has  been  the  major  beneficiary  of 
QUEST.  Through  computer  technology,  it  has  facilitated  the  work  load  of 
physicians  in  utihzation  studies,  quaUty  of  care  studies,  and  medical  research.  It 
has  also  assisted  hospital  administrators  in  analyzing  their  operations.  A  major 
advantage  of  the  QUEST  program  is  that  it  has  been  developed  in  such  a  way  that 
it  can  permit  and  will  permit  compatibility  of  certain  basic  data  with  other 
regional  systems,  with  state  systems,  or  with  a  national  system.  It  will  assist  health 
planning  agencies  in  presenting  facts  regarding  present  patterns  in  the  diagnosis 
and  treatment  of  disease,  on  services  rendered  in  the  hospital,  extended  care 
facility,  nursing  home,  home  care  agencies,  and  the  costs  related  to  these  services. 

3.  The  Hospital  Utilization  Project  (HUP)  of  Western  Pennsylvania  (153) 

Since  HUP's  establishment  in  1963,  it  has  been  headquartered  in  Pittsburgh, 
Pennsylvania,  and  has  operated  as  a  volunteer,  non-profit  organization  co- 
sponsored  by  the  Allegheny  County  Medical  Society  Foundation  and  the  Hospital 
Council  of  Western  Pennsylvania.  HUP  was  organized  to  help  resolve  the  problems 
encountered  by  Western  Pennsylvania  hospital  utilization  committees.  Its 
methodology  was  designed  to  provide  assistance  to  these  committees,  via 
computerized  information  on  all  discharged  inpatients,  and  by  personel  staff 
assistance  in  the  interpretation  and  evaluation  of  the  data. 
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The  pilot  project  began  in  1963  with  14  general  hospitals  in  the  four-county 
area  of  Western  Pennsylvania,  which  comprises  the  Tenth  Councilor  District  of 
the  Pennsylvania  Medical  Society.  When  the  enrollment  of  hospitals  increased  to 
33  by  1966  it  was  then  decided  to  extend  the  HUP  service  to  any  accredited 
hospital  in  Western  Pennsylvania,  and  subsequently  to  all  accredited  hospitals  in 
Pennsylvania  and  bordering  states.  There  has  been  a  gradual  growth  to  a  present 
enrollment  of  over  120  hospitals  in  Pennsylvania,  New  York,  New  Jersey,  and 
West  Virginia. 

In  the  late  1960's,  it  was  recognized  that  hospital  administrators  and  medical 
staffs  needed  more  refined  data  for  management,  planning,  utihzation  review,  and 
medical  care  appraisal.  Accordingly,  in  1968,  it  was  decided  to  undertake 
extensive  re-programming  of  the  HUP  system  with  revision  of  data  collection 
documents  and  additions  and  improvements  to  the  reports  generated.  In  addition, 
a  major  extension  of  HUP  data  collection  began  in  1967  after  the  implementation 
of  Medicare,  when  the  requirements  for  utilization  review  became  applicable  to 
extended  care  facihties.  It  was  recognized  by  the  leaders  of  the  Tenth  Councilor 
District  that,  in  most  cases,  ECF's  lacked  any  formal  medical  staff  structure.  A 
central  review  plan  was  sponsored  by  the  Medical  Society  and  by  Blue  Cross  of 
Western  Pennsylvania  to  perform  utilization  review  for  any  facility  not  having  its 
own  formal  committee.  HUP  was  asked  to  develop  a  tailored  medical  abstract  for 
this  purpose,  as  well  as  for  data  collection  and  reporting.  At  present,  there  are 
over  35  facilities  using  the  central  review  plan  and  there  are  over  15  others  using 
the  approved  methods  of  review  who  submit  medical  abstracts  routinely  to  HUP 
for  analysis  and  compilation  of  comparative  and  illustrative  data. 

The  HUP  system  for  hospitals  was  designed  to  provide  medical  staffs  v^th 
readily  available,  understandable  and  meaningful  data  for  utilization  review  and 
medical  care  appraisal.  Need  for  this  assistance  became  apparent  from  the 
problems  encountered  with  case  review  by  the  early  utilization  committees  which 
were  functioning  in  Western  Pennsylvania  in  1963. 

Early  reviews  were  largely  directed  to  the  study  of  inpatients  with  a 
predetermined  length  of  stay  of  21  or  30  days;  to  cases  designated  as  questionable 
by  third-party  payers;  or  to  samples  of  varying  size,  randomly  selected  from 
monthly  discharges.  These  efforts  were  considered  to  be  policing  actions  and 
physicians  were  critical  of  the  amount  of  time  spent  on  unproductive  reviews. 

HUP,  therefore,  was  initially  designed  to  develop  a  uniform,  mechanized 
approach  to  assembling  necessary  data  for  a  utilization  committee.  Emphasis  was 
placed  on  providing  a  screening  mechanism  to  select  cases  for  productive  review 
and  analysis.  After  a  series  of  refinements  and  improvements,  HUP  placed 
emphasis  on  the  flexibility  and  individuality  in  retrieval  and  use  of  data.  It  is 
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designed  to  meet  the  informational  needs  of  individual  hospitals  upon  request, 
with  special  emphasis  on  the  generation  of  special,  tailor-made  reports. 

The  HUP  approach  is  essentially  simple  and  involves  a  series  of  automated 
steps  that  focus  on  specific  areas  of  hospital  practice: 

•  Medical   record   abstracting  of  forms  suitable  for  electronic  data 
processing. 

•  Control  of  accuracy  and  completeness  of  abstracted  data. 

•  Compilation  of  data  and  generation  of  a  series  of  monthly,  quarterly, 
and  semi-annual  reports. 

•  Summary   comparative   experience   for  specific  major  disease  and 
operation  categories. 

•  Development  of  hospital  profiiles  by  comparative  experience  in  a 
number  of  diagnostic  categories. 

•  Maintenance  of  a  library  of  special  administrative  and  statistical  reports. 

•  Optional  input  or  special  studies  of  administrative  and  professional 
practices. 

•  Automation  of  medical  care  appraisal  and  specific  areas  of  abnormal 
experience. 

The  basic  HUP  program  offers  a  pattern  review  technique,  where  data  on  all 
discharged  patients  are  collected  and  permits  analysis  of  hospital  utilization  by 
major  specific  diagnostic  category,  for  the  purpose  of  drawing  attention  to 
practices  that  may  be  modified  for  groups  of  patients.  Simple  average  length  of 
stay  tables  and  hospital  profiles  allow  the  utilization  review  committee  to  focus 
on  a  series  of  cases  where  review  might  be  productive.  This  permits  thorough 
committee  evaluation  of  individual  cases,  identification  of  valid  medical  reasons 
from  variance  from  community  experience,  and  highlights  extraordinary  medical 
practice  that  might  require  attention.  In  addition,  detailed  analysis  of  individual 
cases,  guided  by  accepted  criteria,  provides  an  in-depth  medical  care  appraisal 
technique. 

Much  of  the  HUP  data  collection  techniques  have  been  derived  from  the 
experience  of  others;  namely,  PAS.  As  with  PAS,  the  process  begins  in  the 
hospital  medical  record  department,  where  the  medical  record  abstract  is 
completed  for  every  discharged  inpatient.  Most  of  the  entries  on  the  revised  HUP 

230 


Arthur  D  Little  Inc 


abstract  are  available  from  the  facesheet  of  the  patient's  chart,  to  lessen  the  need 
for  interpretation  by  a  clerical  abstractor.  It  is  estimated  the  abstract  can  be 
completed  within  five  minutes,  depending  on  the  complexity  of  the  case  and  the 
form  of  the  hospital's  facesheet.  Since  the  abstracted  data  becomes  the  basis  for 
all  reports,  time  and  accuracy  are  the  two  items  of  prime  importance. 

To  insure  confidentiahty,  the  hospital,  patient,  physician  identifications  are 
recorded  in  code  form.  Code  numbers  are  provided  by  HUP.  Diagnoses  and 
surgical  procedures  are  coded  in  ICDA-8  and  are  written  out  in  standard 
nomenclature  as  well,  to  aid  HUP  personnel  in  the  detection  and  correction  of 
errors.  As  with  PAS,  HUP  provides  continuing  instruction  in  ICDA  coding,  in 
both  individual  and  group  sessions. 

The  case  abstract  is  usually  prepared  in  duplicate,  as  soon  as  practical  after 
discharge,  and  completed  by  the  medical  record  clerk  as  the  patient's  record  is 
closed  out  before  filing.  Carbon  copies  are  retained  by  the  hospital,  until  the 
monthly  listings  are  returned  and  are  checked  for  possible  errors.  Originals  of 
completed  abstracts  are  submitted  to  HUP  on  a  monthly  basis  and  are  forwarded 
to  HUP  quality  controllers  in  batches  of  1 00  for  error-checks. 

The  original  reports  emerging  from  HUP  processing  were  of  two  basic  types: 

(a)  Those  useful  in  utilization  review,  and 

(b)  Those  which  could  replace  hand-prepared  indexes  and  tabulations  in 
the  hospital/medical  record  department. 

HUP  has  revised  this  original  program  and  the  basic  reports  have  been 
supplemented  by  periodic  and  operational  reports  of  medical  audit  and  quality  of 
care  data  and  by  the  creation  of  a  Ubrary  of  special  reports  that  can  readily  be 
modified  and  retrieved  according  to  the  information  needs  of  the  user.  The 
routine  reports  are  as  follows: 

Monthly  Reports 

•     Discharge  Analysis 

This  report  provides  a  service-by-service  analysis  of  total  cases,  days  of 
stay,  age  and  sex  distribution,  emergency  admissions,  death,  consulta- 
tion, pay  status,  etc.  In  addition,  it  provides  a  summary  and  analysis  by 
percentage  of  transfers,  death  rate,  autopsy  rate,  and  consultation  rate, 
as  well  as  analysis  by  day  of  the  week  of  admission  and  discharge.  It 
does  not  include  diagnoses  or  operative  procedures.  Therefore,  a 
sub-routine  has  been  developed,  utilizing  a  half-sheet  overlay  of  the 
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abstract  that  can  be  completed  on  discharge  without  waiting  for 
completion  of  the  patient's  record.  This  provides  an  advanced  discharge 
analysis,  which  can  be  returned  to  the  hospital  shortly  after  the  end  of 
the  reporting  month. 

•  Diagnosis,  Operation  and  Death  Listings 

These  reports  are  optional  to  the  participating  hospitals.  In  the 
diagnosis  listing,  all  patients  having  the  same  primary  diagnosis  are 
listed  as  a  group,  sequentially  by  length  of  stay.  In  the  operations 
listing,  all  patients  having  the  same  operative  procedure  are  listed 
together,  sequentially,  by  post-operative  days  of  stay.  The  death  listing 
is  for  those  patients  who  died  during  the  discharge  month. 

Periodic  Scheduled  Reports 

Two  specific  reports  are  provided: 

•  Length  of  stay  comparison,  and 

•  Quality  of  care  comparison. 

The  length  of  stay  comparison  report  is  based  on  the  discharge  month  with  a 
hospital-to-hospital  comparison  for  the  average  length  of  stay  by  broad  service 
groupings.  The  quality  of  care  comparison  report  compares  similar  hospitals  on  a 
monthly  basis  by  selected  quality  of  care  indicators,  including  gross  death  rate, 
net  death  rate,  autopsy  rate,  post-operative  death  rate,  consultation  rate  and 
transfer  rate. 

Semi-Annual  Reports 

Semi-annual  reports  are  generated  to  supply  a  diagnosis  index,  operations 
index,  complete  physician,  surgeon,  and  consultant  listings,  and  a  summary  of 
monthly  discharge  analysis  data.  These  reports  include: 

•  Diagnosis  Index  and  Operation  Index 

The  appropriate  patient  data  is  listed  under  each  of  the  diagnoses  or 
operations  which  have  been  recorded.  If  the  patient  had  three 
diagnoses,  it  will  appear  on  the  index  three  times,  once  under  each 
diagnosis.  The  index  is  designed  so  that  all  cases  where  the  applicable 
diagnosis  or  operation  was  primary,  appears  first,  followed  by  a  detailed 
analysis. 
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•  Physician,  Surgeon  and  Consultant  Listings 

These  reports  list  for  each  physician,  all  cases  for  whom  he  was 
reported  as  either  attending  surgeon,  or  consultant. 

•  Discharge  Summary 

This  is  a  simple  six-month  summary  of  data  shown  on  the  monthly 
discharge  analyses. 

Statistical  Reports 

These  reports  are  prepared  from  the  semi-annual  disease  indexes  and  are 
simple  tables  of  the  average  length  of  stay  for  the  more  common  diagnoses  and 
operative  procedures  for  which  hospitalization  was  required.  Since  most  prac- 
ticing physicians  are  unfamiUar  with  statistics,  HUP  uses  the  mean  as  the  value  to 
be  recorded,  since  it  is  a  familiar  term  and  one  whose  use  requires  no  explanation. 
Reports  are  prepared  for  some  20  diagnostic  categories  and  are  distributed 
periodically  in  a  sequence  designed  to  rotate  interests  among  the  various  services. 
Uniform  definitions  are  used  to  select  cases  from  the  semi-annual  indexes  that  are 
used  in  the  preparation  of  statistical  tables.  In  addition,  separate  reports  are 
prepared  for  groups  of  hospitals  according  to  size,  staffing,  services  and  setting. 
The  names  of  the  hospitals  appear  in  these  reports,  pennitting  each  hospital  to 
evaluate  its  experience  against  others,  which  are  considered  to  be  comparable. 

Hospital  Profile 

By  combining  the  data  from  the  statistical  reports,  HUP  semi-annually 
constructs  three  simple  bar-graph  profiles  for  each  hospital;  one  each  for 
medical-surgical,  obstetric-gynecologic,  and  specialty  diagnoses,  displaying  the 
hospital's  relative  length-of-stay  rank  for  each  diagnosis  among  a  group  of 
comparable  hospitals. 

Special  Reports 

One  of  the  more  important  aspects  of  HUP  is  the  ability  to  generate  any  one 
of  the  series  of  special  reports  at  the  request  of  an  individual  hospital.  The  HUP 
library  consists  of  approximately  25  report  formats  which  the  hospital  can 
request  simply  by  specifying  the  parameters. 

It  was  intended  that  the  basic  HUP  program  would  be  used  as  a  screening 
device  to  draw  attention  to  patterns  of  care,  rather  than  attempting  to  identify 
individual  deviant  cases.  The  comparative  statistical  hospital  profiles  provide  a 
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parallel  series  of  cases  from  similar  medical  sources  against  which  the  hospital's 
length  of  stay  experience  can  be  evaluated.  Although  experience  differing  from 
comparable  hospitals  is  not  necessarily  wrong,  it  might  suggest  to  a  medical  staff 
that  a  study  of  a  series  of  cases  might  be  worthwhile. 

HUP  also  provides  the  medical  staff  committee  with  detailed  individual  case 
review  worksheets  to  be  used  to  focus  on  specific  disease  categories.  As  an  aid  to 
the  reviewing  physicians  HUP  has  prepared  a  criteria  manual,  containing 
guidelines  for  quality  of  care  in  some  70  major  diagnoses.  Although  the  criteria 
are  neither  rigid  nor  inflexible,  the  attempt  is  to  establish  norms  of  what  is 
considered  to  be  good  medical  care.  Evaluation  of  completed  worksheets  permits 
identification  of  valid  medical  reasons  for  variance  and  highlights  extraordinary 
medical  factors  that  might  require  attention.  The  detailed  analysis  of  individual 
cases  guided  by  such  criteria  provides  an  in-depth  appraisal  of  the  quality  of  care 
provided.  HUP  also  offers  additional  help  in  medical  care  appraisal  by  the 
generation  of  periodic  quality  of  care  analyses  and  by  offering  the  opportunity  of 
optional  reporting  of  medical  audit  items  of  special  interest  to  a  medical  staff. 

The  ongoing  review  of  HUP  data  on  hospital  use  acts  as  a  primary 
educational  experience  for  medical  staff  committee  members.  Committee  findings 
and  evaluations  based  on  these  data  provide  valuable  factual  information  for 
medical  staff  discussions,  clinical  conferences,  resident  training,  and  other 
in-hospital  continuing  education  programs. 

HUP  data  provides  a  valuable  resource  not  only  for  internal  medical  staff 
use,  but  also  for  demographic  and  epidemiologic  studies  on  a  local  or  regional 
basis.  Such  studies  might  include  incidence  of  acute  coronary  occlusion  or  an 
analysis  of  rehabilitation  potential.  HUP  has  also  assisted  the  Western  Pennsylva- 
nia Regional  Medical  Program  in  refining  education  and  training  needs  for  its 
28-county  area. 

HUP  was  designed  to  take  advantage  of  what  may  be  termed  provincialism. 
It  was  considered  far  more  effective  to  focus  comparisons  on  data  generated  from 
within  the  region  rather  than  with  some  geographically  remote  area.  Practical 
experience  has  demonstrated  that  effective  application  of  statistical  data  is 
enhanced  by  central  staff  assistance.  Since  HUP  is  limited  to  a  region,  its  staff  is 
able  to  provide  such  direct  personal  assistance  in  the  interpretation  of  data  and 
design  of  special  studies.  However,  certain  valid  questions  can  be  raised 
concerning  the  basic  system,  especially  the  decision  to  adopt  the  mean  as  the 
standard  of  comparison.  A  continuing  limitation  is  the  number  of  diagnostic 
categories  suitable  for  comparative  analysis,  since  there  are  few  reasons  for 
hospitalization  that  occur  in  pure  form  and  sufficient  numbers  in  an  average 
hospital  in  a  limited  period  of  time.  HUP's  successes  do  not  rest  solely  on  the  fact 
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that  they  have  an  efficient  and  sophisticated  information  system,  but  primarily  on 
the  fact  that  hospital  and  medical  staffs  have  been  willing  to  use  the  data 
resources  available  and  are  able  to  translate  the  data  into  meaningful  and  relevant 
information. 

4.  Health  Service  Data  (HSD-W)  of  Wisconsin,  Inc.  (225) 

HSD-W  began  in  1966  to  provide  a  locally  operated  system  of  analysis  of 
hospital  discharges.  It  was  originally  conceived  by  a  community  group  represent- 
ing hospitals,  the  medical  profession,  labor,  industry,  and  the  health  insurers  of 
the  Milwaukee  area  who  became  known  as  the  Milwaukee  Medical  Resources 
Study  Committee.  Its  original  purpose  was  to  provide  assistance  to  utilization 
review  committees  of  hospitals  of  the  state  in  identifying  problem  areas  for 
intensive  review  and  action.  Of  the  available  health  data  systems  operating  in  the 
country  which  could  be  used  as  models,  HUP  was  selected  for  a  number  of 
reasons. 

Shindell  (225)  claims  that  the  basic  test  of  any  health  data  collection 
organization  should  start  with  the  objective  to  be  gained  by  analysis  of  the  data  to 
be  collected.  Once  the  objective  is  clear,  then  the  issue  of  the  practicality  of 
obtaining  the  data  desired  and  possible  by-products  of  the  data  collection 
technique  must  be  considered.  Shindell  has  identified  a  series  of  objectives  dealing 
with  hospital  discharge  systems: 

•  Supply  of  data  for  various  review  mechanisms,  e.g.  audit,  death  review, 
and  utilization  review. 

•  Supply  of  data  for  both  clinical  and  epidemiologic  research. 

•  Preparation  of  indexes  required  by  JCAH. 

•  Supply  of  data  for  specific  accreditation  purposes,  e.g.,  residency 
training  programs. 

•  Obtaining  data  for  overall  analysis  of  hospital  activity  for  internal  and 
external  planning. 

Shindell  goes  on  to  state  that  when  HUP  started,  its  specific  objective  was  to 
serve  utilization  committees.  The  plan,  as  it  evolved,  attempted  to  include,  as 
concomitant  services  to  participating  hospitals,  data  which  would  serve  as  many 
additional  objectives  as  might  be  attainable  on  a  practical  basis.  In  contrast,  he 
claims,  the  month  when  CPHA  was  estabhshed,  its  primary  concern  appeared  to 
be  medical  audit,  and  its  extension  into  utilization  review  was  relatively  late  in 
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developing.  He  also  feels  that  the  QUEST  program  in  Ohio  began  on  a  simpler 
level  and  was  then  modified  and  expanded  in  response  to  local  desires.  Therefore, 
HUP  was  selected  as  the  model  for  Wisconsin  since  the  basic  desire  of  HSD-W  was 
to  remain  as  simple  as  possible,  providing  a  basic  service  that  most  nearly  reflected 
the  common  denominator  of  priority  objectives  and  offering  optimal  reports  to 
meet  the  specific  needs.  In  addition,  the  scope  of  HSD-W  data  could  be  expanded 
as  demand  developed. 

The  basic  HSD-W  abstract  form  and  report  is  very  similar  to  HUP.  HSD-W 
has  made  two  modifications  in  the  abstract:  allowance  for  a  hospital  code 
designed  to  reflect  size,  location  and  type  of  ownership;  and  allocation  of  space 
for  reporting  the  patient's  zip  code.  After  HSD-W  began,  it  was  determined  that 
community  agencies  wanted  different  age  breakdowns  and  identification  of 
census  tracts.  HSD-W  was  able  to  satisfactorily  comply  with  the  required  age 
breakdown,  but  decided  not  to  use  census  tract  because  of  the  time  required  in 
coding  to  determine  patient's  home  residence  by  census  tract.  It  was  felt  that  zip 
codes  were  satisfactory  and  that  if  necessary  for  study  purposes,  census  track 
distribution  could  be  estimated  from  zip  codes. 

The  philosophy  of  HSD-W  is  that  the  principal  motivation  for  fostering  and 
developing  abstract  systems  in  most  communities  is  the  expectation  that  the  use 
of  the  system  will  improve  the  effectiveness  of  the  hospital  as  a  resource,  either  in 
adjusting  length  of  stay  to  an  optimal  level,  reducing  or  eliminating  unnecessary 
admissions  or  in  processing  data  for  long-range  planning  in  regard  to  the  amount 
and  type  of  services  needed  in  the  future.  HSD-W  postulates  that  there  has  been 
relatively  little  use  of  the  data  from  routine  abstracting  systems  for  the  last  stated 
purposes,  but  the  availability  of  such  data  as  a  by-product  of  the  more  immediate 
goal  of  limiting  current  hospital  use  has  been  recognized.  Therefore,  HSD-W  feels 
that  relatively  little  data  needs  to  be  collected  on  a  repetitive  basis.  Recognizing 
the  time  and  expense  involved  in  record  abstracting,  HSD-W  restricts  the 
collection  of  data  to  that  which  is  considered  essential. 

Attached  is  a  table  prepared  by  HSD-W  which  summarizes  the  data  content 
of  the  three  principal  types  of  data  collection  systems  as  analyzed  from  the 
published  reports  of  sponsors.  The  major  differences  among  the  several  systems 
are  largely  the  amount  and  type  of  clinical  laboratory  studies  that  are  reported. 
HUP  and  HSD-W  collect  the  minimum  amount  of  clinical  data  on  the  patient  and 
are  the  general  prototype  for  some  of  the  new  systems  which  have  been 
introduced  by  several  Blue  Cross  plans.  PAS-MAP  collects  considerably  more  data 
for  evaluation  of  patient  care  as  does  the  QUEST  system.  The  California  Health 
Data  Corporation  (MRj )  illustrates  the  admission-separation  type  of  data  system; 
introduces  several  new  features  and  can  be  seen  as  a  compromise  between  the  first 
two  types  of  systems  in  that  it  reports  a  selected  number  of  items  designed  to 
assist  in  the  medical  audit. 
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COMPARISON  OF  DATA  COLLECTED  BY  THREE  TYPES  OF  SYSTEMS* 


Patient  Identification  and  Characteristics 


HUP  and  MR^ 
HSD-W  PAS-MAP  (California) 


Medical  record  number 

Name 

Residence 

Age 
Sex 

Race/origin 
Religion 
Marital  status 
Record  of  readmission 


X (HSD-W) 
zip  code 

X 
X 
X 


zip  code  or 
county  code* 
birth  date 

X 


Administrative  and  financial  data 


Hospital  code  x  x  x 

Class  of  admission  x  x  x 

Source  of  referral  x  (HUP)  —  x 

Admission  and  discharge  dates  x  x  x 

Hour  of  admission  x  —  — 

Hospital  service(s)  x  x  x 

Type  of  accommodation  at  discharge       x  —  — 
Time  elapsed  before  (or  date  of) 

surgery  x  x  x 

Referral  to  committee/special  case  —  x  x 

Admitting  physician  —  —  x** 

Attending  physician  x  x  x 

Consulting  physician(s)  x  x  x 

Source  of  payment  x  x  x 

Total  bill  -  _  X** 
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COMPARISON  OF  DATA  COLLECTED  BY  THREE  TYPES  OF  SYSTEMS* 

(Continued) 


HUP  and 
HSD-W 


PAS -MAP 


MR 


(California) 


Clinical  data 


Admission  diagnosis 
Primary  and  other  diagnoses 
Principal  and  other  surgical 

procedures 
Tissue  report 
Anesthesia 

Total  number  of  consultations 
Findings  of  admission  investigation 

(hemoglobin,  temperature,  BP, 

urinalysis,  WBC) 
Check  lists  of  examinations, 

laboratory,  x-ray,  and  function 

tests  performed 
Check  list  of  drugs  administered 

by  major  categories 
Other  therapy 

Occupancy  of  special  care  units 
Presence  of  hospital-acquired 

infections  and  other 

complications 
Discharge  status  and  destination 

(including  type  of  death  and 

autopsy) 


X  (HUP) 


transfusions 
only 


*Based  on  1969  case  abstracts;  not  included  are  data  on  obstetrical  cases  and 
unidentified  special  studies  and  options,  for  which  space  is  provided  by  all  three 
types  of  systems  (225). 

**Optional  items. 

***Space  provided  to  record  "no  minimum  lab  or  x-ray". 

I 
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It  is  the  philosophy  of  the  simpler  health  data  systems  like  HSD-W  and  HUP 
that  once  the  basic  data  are  collected  and  used  to  reflect  overall  patterns  of  care, 
sufficient  information  to  serve  as  the  screening  function  has  been  obtained. 
Sufficient  data  are  also  available  to  serve  as  the  basis  for  specially  designed 
studies.  If  individual  case  analyses  are  required,  it  should  be  directed  towards  an 
apparent  problem  and  should  resort  to  examination  of  the  full  medical  record  to 
be  meaningful.  The  reports  generated  by  HSD-W  are  as  follows  (96): 

Monthly  Reports 

•  Diagnosis  listing 

•  Y-Codes  listing,  procedure  listing,  death  listing,  discharge  analysis, 
physician  activity 

Periodic  Reports  (Quarterly,  Semi-annually) 

•  Diagnosis  index 

•  Procedure  index 

•  Profile  studies 

Special  Reports  and  Studies  on  Request 

HSD  feels  that  the  common  denominator  of  a  basic  health  data  system  — 
practical  for  the  small  hospital  and  usable  by  a  large  medical  center  —  seems  to  be 
a  suitable  compromise.  Optional  studies  utilizing  basic  data  in  response  to  the 
needs  of  the  particular  participant,  is  achievable  with  this  system. 

5.  The  California  Health  Information  for  Planning  Service  (CHIPS) 
Demonstration  Project  (156) 

The  CHIPS  Demonstration  Project  operated  from  June  15,  1965  through 
May  31,  1968.  The  objective  of  the  project  was  to  test  various  parts  of  an 
information  system  for  health  planning,  including  a  hospital  discharge  abstract 
system  called  the  Hospital  Administrative  Planning  Data  Processing  Service 
(HAPDaPS).  The  project  was  also  concerned  with  the  need  to  coordinate  data  for 
many  hospital  abstract  systems  and  other  information  systems  pertinent  to  health 
planning.  HAPDaPS  was  strongly  influenced  by  the  overall  CHIPS  concept 
although  it  was  entirely  capable  of  operating  independently  of  CHIPS. 
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CHIPS  was  intended  to  simplify  the  collection  and  storage  and  use  of  data 
related  to  health  planning.  It  recognized  that  numerous  voluntary  and  public 
groups  were  interested  in  the  same  information  for  decision-making  purposes.  The 
approach  taken  was  that  basic  suppliers  of  information  are  also  primary  users  who 
can  identify  the  information  needed  for  the  decisions,  approve  the  forms  used  for 
collecting  data,  and  specify  the  manner  in  which  data  would  be  reported  back  to 
them.  The  CHIPS  concept  in  turn  recognized  that  each  user  generates  information 
of  interest  to  others  and  that  significant  data  could  be  generated  by  non-users  of 
the  system. 

The  CHIPS  system  was  designed  to  take  advantage  of  all  pertinent 
information  available  and  used  an  integrated  file  structure  to  enter  the  data  in 
sufficient  detail  to  allow  computer  programs  to  assemble  the  data  into  reports 
devised  by  system  users.  The  availability  of  planning  data  under  the  CHIPS  system 
was  linked  to  the  development  of  four  categories  of  information,  organized  into 
computer  files  to  allow  for  retrieval  and  maintenance  of  information.  These 
categories  were: 

^»  Institution-referenced  data  file,  which  included  facts  and  figures  on  the 
operations  of  institutions,  including  patient  utilization. 

•  Standards-referenced  data  file,  which  included  data  on  standards  for 
licensing  institutions. 

•  Geographic-referenced  data  file,  which  included  data  on  population, 
geographic  divisions,  and  locations  and  transportation  networks. 

•  Personnel-referenced  data  file^,  which  included  data  on  identification, 
credentials,  employment,  and  related  material  for  professional  and 
technical  personnel. 

HAPDaPS,  the  hospital  abstract  portion  of  CHIPS,  was  developed  to 
ascertain  whether  it  could  provide  detailed  utilization  data  indexed  for  use  by 
administrative  and  medical  personnel  and  economically  generate  the  data  needed 
for  areawide  health  planning.  CHIPS  concentrated  the  data  collection  within  three 
representative  Santa  Clara  county  hospitals  of  596  beds,  227  beds,  and  48  beds, 
respectively.  The  CHIPS  staff  adopted  certain  standards  for  review  of  how  case 
abstract  systems  measure  up  to  a  hospital's  needs,  which  included: 

•  Cost 

•  Timeliness 
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•  Format 


•  Use  of  work  simplification  principles 

•  Use  of  data  processing  principles 

•  Accuracy  and  validity 

Two  forms  were  used  for  gathering  utilization  data  from  the  three  hospitals; 
namely,  the  CHIPS  patient-case  abstract  and  the  daily  discharge  and  service 
transfer  Ust.  For  each  data  item  included,  an  expected  user  was  identified;  either  a 
hospital  or  a  planning  agency. 

In  designing  and  programming  the  HAPDaPS  system,  the  principle  of 
gathering  data  as  a  by-product  of  routine  daily  operations  of  the  health  care 
facility  was  adhered  to.  To  an  extent,  however,  this  principle  was  modified  by  the 
fact  that  the  HAPDaPS  project  was  a  demonstration,  as  opposed  to  an  ongoing 
system.  Given  these  circumstances,  it  was  not  feasible  to  design  the  input 
procedures  and  forms  to  replace  existing  systems  within  the  hospitals.  This  would 
have  been  desirable  if  CHIPS  were  an  ongoing  system. 

Information  collected  on  the  patient  case  abstract  was  oriented  towards 
hospital  operation  and  planning.  It  did  not  include  detailed  data  on  the  patient's 
medical  treatment,  but  did  cover  some  of  the  requirements  of  the  JCAH.  It  also 
made  provision  for  certain  information,  such  as  census  tract  of  the  patient,  which 
was  not  usually  included  in  abstracts  used  by  other  systems.  Twelve  monthly 
reports  were  designed  in  conjunction  with  the  three  participating  hospitals.  To 
insure  promptness  and  maximum  utility  of  output  reports,  the  system  was 
designed  to  produce  output  reports  in  two  phases: 

Management  Reports 

•  Summary  information  on  patient  care  activities 

•  Patient  days  by  service  and  licensed  bed  categories 

•  Monthly  utilization  by  licensed  service 
Patient- Related  Reports 

•  Summary  information  on  patients  discharged,  excluding  newborns 

•  Summary  information  on  discharged  newborn  patients  only 
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•  Operations  and  treatments 

•  Summary  by  length  of  stay 

•  Operation  and  treatment  summary  by  age  and  sex 

•  Diagnosis  and  treatment  summary  by  length  of  stay 
®      Diagnosis  and  treatment  summary  by  age  and  sex 

•  Diagnosis  index  report 

•  Operation  index  report 

•  Physician's  index  report 

The  diagnosis  and  operation  report  lists  the  25  most  frequent  diagnoses  and 
operations  for  the  individual  hospital  each  month.  The  management  report  series 
was  designed  to  return  needed  administrative  data  to  the  hospital  as  quickly  as 
possible,  following  the  close  of  the  month.  The  remaining  reports,  which  relate 
primarily  to  discharge  and  medical  practice,  were  designed  to  be  returned  to  the 
facility  as  soon  as  possible,  recognizing  that  this  information  relied  upon 
completion  of  the  medical  record  as  abstracted  by  the  medical  records 
department  and  was  subject  to  somewhat  longer  delay  than  admission  data. 

Although  the  institutions  participating  were  limited  in  number,  this 
demonstration  showed  the  feasibility  of  operating  a  service  based  on  a  two-part 
patient  abstract.  The  activity  was  a  logical  precursor  to  a  system  more  appropriate 
for  changing  requirements  of  hospitals:  a  system  able  to  combine  and  supply  both 
billing  and  patient  care  information  within  the  time  limitations  required  by 
specific  functions. 

An  ongoing  HAPDaPS  system  would  have  several  advantages  over  the 
demonstration  system.  CHIPS  admission  information  could  be  gathered  as  part  of 
the  routine  admission  procedure,  which  would  be  done  by  making  input 
documents  into  a  facesheet  within  the  patient's  medical  record,  which  would  be 
completed  during  the  admission  procedure.  All  physician  numbers  would  be 
conceivably  a  part  of  some  state-wide  numbering  system,  such  as  license  number. 
Census  tract  number  and  county  code  could  be  assigned  by  computer  using 
programs  developed  by  transportation  planning  groups  and  the  Bureau  of  Census. 
It  would  not  be  necessary  to  code  all  admissions  by  census  tract  on  a  routine  basis 
to  meet  the  reporting  needs  of  hospitals. 
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The  management  reports  were  described  as  being  well  received,  since  they 
organized  pertinent  material  into  a  usable,  convenient  form  for  administrators. 
The  two-part  abstract  approach  coupled  with  the  daily  report  on  changes  in  the 
patient's  status  also  proved  to  be  most  valuable.  HAPDaPS  did,  however,  lack 
cross-data  for  billing  and  therefore,  was  not  picked  up  by  any  of  the  three 
hospitals,  although  computer  programs  were  available  at  nominal  cost. 

The  major  portion  of  the  CHIPS  effort  was  the  development  of  reports  for 
health  planning  purposes.  HAPDaPS  and  equivalent  systems  were  seen  as  the 
source  of  patient  utilization  data  required  from  institutions.  During  the 
demonstration,  planning  agency  representatives  worked  with  representatives  of 
state-wide  professional  organizations  and  the  CHIPS  staff  to  develop  five  areawide 
planning  reports: 

•  Bed  Status  Summary  by  Institution,  Class,  and  Licensed  Service. 

•  Utilization  Summary  by  Institution  and  Service. 

•  All  Hospitals  or  Selected  Hospitals  within  a  Given  Area. 

•  Patient  Travel  Time  Analysis  —  Admissions  Only. 

•  Hospital  Site  Evaluation  —  Site  "A"  Travel  Time  From  This  Site. 

From  these  reports,  data  would  be  required  from  more  than  one  institution 
as  weU  as  from  non-health  field  sources,  and  there  were  major  problems  in 
coordination  and  confldentiahty. 

It  was  determined  during  the  CHIPS  demonstration  that  desired  planning 
data  could  be  integrated  and  obtained  through  an  independent,  non-profit 
corporation.  The  primary  function  of  such  a  corporation  would  be  to  provide  a 
mechanism  for  exchanging  health  information.  As  a  consequence,  the  California 
Hospital  Association  and  the  CaUfomia  Medical  Association  took  the  lead  in 
forming  such  a  corporation  known  as  the  California  Health  Data  Corporation. 

In  addition,  the  projected  health  planning  information  exchange  was  viewed 
as  both  a  mechanism  to  facilitate  the  exchange  of  information  and  as  a  buffer  to 
assure  a  high  degree  of  confidentiality  for  the  participants.  It  was  viewed  to  have 
the  capability  of  linking  up  with  other  planning  systems. 

The  exchange  was  not  seen  so  much  as  a  data  bank  for  information  on 
specific  individuals,  but  rather  as  a  mechanism  for  acquiring  summary  data,  as  a 
by-product  of  the  operations  of  institutions  and  agencies,  and  for  storing  the  data 
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in  computer  processable  form.  The  information  stored  could  be  keyed  to  census 
tracts.  These  data  bases  could  include  such  things  as  information  on  utilization 
health  facihties  and  services,  environmental  health  factors,  as  well  as  demographic 
data  classified  by  census  tracts. 

The  experience  of  CHIPS  demonstrated  that  if  a  coordinated  system  of 
hospital  reporting  in  the  United  States  were  to  succeed,  the  following  conditions 
must  be  met: 

•  Supphers  of  the  data  get  valuable  feedback. 

•  Data  are  handled  by  a  neutral  group. 

•  Suppliers  of  data  have  a  representation  in  the  neutral  group. 

•  The  individual  is  not  identified  but  data  can  be  manipulated  on  an 
individual  basis. 

•  The  system  is  prepared  to  accept  tapes  from  facilities  that  have  their 
own  computer  and  do  not  use  abstract  forms. 

•  The  system  must  have  a  high  level  of  participation  in  order  to  be 
valuable  for  social  planning. 

•  The  system  must  relate  to  geographic  areas  so  that  it  can  be  used  in 
conjunction  with  environmental  and  socio-economic  data,  since  health 
planning  data  are  not  hmited  to  accounts  of  diagnoses. 

6.  MR   -The  Medical  Record  System  of  the  California  Health  Data  (148) 
Corporation  (CHDC) 

The  California  Health  Data  Corporation  (CHDC)  is  a  non-profit,  private 
organization  founded  in  October,  1967  by  the  Cahfornia  Hospital  Association  and 
the  California  Medical  Association.  Two  motivating  forces  brought  CHDC  into 
existence  and  determined  its  objectives: 

(a)  The  first  factor  was  the  CHIPS  demonstration  project  of  the  California 
State  Department  of  Public  Health.  One  of  the  significant  contributions 
of  CHIPS  was  to  give  representatives  of  hospitals  and  the  medical 
community  the  opportunity  to  become  involved  in  specifying  informa- 
tional needs  for  health  planning.  The  CHIPS  project  alerted  the 
voluntary  sector  to  the  importance  of  data  systems  that  would  yield  a 
greater  magnitude  of  information  about  health  care  and  brought  new 
realism  to  the  issues  of  who  would  operate  such  systems  and  for  what 
purposes. 
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(b)  The  second  factor  stemmed  from  the  fact  that  hospital  leaders  were 
finding  themselves  in  negotiation  situations  in  which  necessary  data 
were  lacking.  This  stark  realization  came  about  when  they  attempted  to 
work  with  federal  officials  on  the  terms  with  which  Medicare  would  be 
implemented.  While  federal  officials  had  reams  of  statistics,  the 
representative  hospitals  virtually  had  none.  As  a  consequence  of  these 
early  Medicare  sessions,  it  was  determined  by  the  California  hospital 
leaders  that  data  would  have  to  be  available  to  verify  what  their 
practical  experience  showed.  In  essence,  the  final  stages  of  the  CHIPS 
demonstration  project  became  the  beginnings  of  the  California  Health 
Data  Corporation. 

The  objective  of  the  state-wide  medical  record  system  in  Cahfornia  preceded 
any  commitment  to  the  kind  of  organization  that  would  operate  the  system.  Two 
years  before  CHDC  was  incorporated,  negotiations  had  begun  with  CPHA.  The 
hope  was  that  PAS  would  operate  out  of  a  local  center  serve  as  the  foundation  for 
a  health  data  center  in  Cahfornia.  This  idea  did  not  come  to  fruition. 
Representatives  from  CHA  and  CMA  investigated  this  and  other  alternatives 
during  the  two-year  period  before  the  formal  organization  of  CHDC.  At  the  time 
CHDC  was  incorporated,  the  following  options  remained: 

•  An  entirely  new  system 

•  PAS 

•  The  CHIPS  system 

•  Medi-Record 

Medi-Record  was  finally  chosen  because  it  brought  an  operating  system  of 
proven  value,  all  the  technical  staff  needed  for  maintenance  and  expansion  of  the 
system,  and  a  certain  amount  of  revenue.  The  contract  with  Pennsylvania 
Tabulating  Service  (PenTab),  the  service  bureau  for  Medi-Record,  was  made  in 
April,  1968  and  was  followed  by  two  activities: 

•  Promotion  of  Medi-Record  to  California  hospitals 

•  Designing  an  improved  system  to  replace  Medi-Record 

By  the  end  of  1968,  135  hospitals  were  participating  and  were  wilhng  to 
replace  Medi-Record  with  MRi . 
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In  itself,  MRi  represents  no  significant  advance  over  other  existing  medical 
record  information  systems,  either  conceptually  or  technologically.  It  was 
intended  to  incorporate  data  which  was  of  established  value  for  hospitals  as  well 
as  to  use  well  established  data  processing  procedures.  MRj  had  the  following 
characteristics: 

•  Patient  and  Physician  Identification 

Room  was  allowed  for  Social  Security  numbers  as  patient  identifiers. 
Patient  name  can  be  recorded  on  the  abstract  and  is  used  for 
convenience  and  computer  printed  indexes  rather  than  for  unique 
identification  of  individuals.  Physician  identification  is  by  number  on 
the  case  abstract  but  the  hospital  also  must  submit  a  roster  of  physician 
names.  The  names  can  be  included  on  the  computer  printed  reports. 
The  Board  of  Directors  of  CHDC  established  a  policy  that  when  data 
are  transferred  from  the  operational  MRi  to  permanent  CHDC  files, 
physician  and  patient  names  will  be  ehminated.  Consequently,  either 
the  design  of  MRj  or  the  policy  under  which  it  is  operated  is  suitable 
for  a  registry-type  system. 

•  Service 

MRj  found  it  impossible  to  come  up  with  an  extended  list  of  service 
categories  that  would  satisfy  all  hospitals.  Consequently,  up  to  99 
service  categories  of  the  hospital's  own  specification,  including  how 
these  services  were  to  be  grouped,  in  the  categories  of  pediatrics, 
medicine,  surgery,  etc.,  were  provided.  Also  provided  were  up  to  10 
subdivisions  within  these  services. 

•  Optional  Items 

The  following  items  were  optional: 

—Patient  name 
—Zip  code 
—Company  code 
—Race 
—Religion 

—Admitting  physician 
—Admitting  diagnosis 
-Total  bill 
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•  Diagnosis  and  Operation  Codes 

Under  MR^  the  hospital  may  use  either  ICDA-8  or  CPHA's  H-ICDA. 
Even  though  a  case  abstract  permits  up  to  13  diagnoses  and  14 
operations,  there  were  medical  record  librarians  who  were  concerned 
about  having  any  finite  hmit  to  the  number  that  can  be  recorded.  Thus, 
MRj  has  the  capabiUty  to  accept  supplementary  case  abstracts  with 
more  diagnoses  and  operations. 

The  data  base  of  MR^  consists  of  the  following: 

•  Patient  identification  and  social  characteristics 

•  Diagnosis  and  procedure  information 

•  Planning  data 

•  Minimal  financial  data  (total  charges) 

•  Availability  of  optional  data 

MR^  produces  the  following  reports  on  a  monthly  and  semi-annual  basis: 

•  Discharge  analysis  by  service 

•  Discharge  analysis  by  payment 

•  Discharge  analysis  by  diagnosis 

•  Diagnosis  index 

•  Operation  index 

•  Physician  and  surgeon  index 

•  Special  audit  listing  (Monthly  only) 

MR  J  was  viewed  as  a  fundamental  system  to  which  supplementary  modules 
with  more  sophisticated  input/output  capability  could  be  added.  They  were: 

•  MR^  —  a  system  that  would  incorporate  the  ideas  of  the  CHIPS  and 
HAPDaPS  systems. 
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•  MR^  —  a  system  that  would  present  data  for  medical  auditing. 

•  MR^  —  an  information  retrieval  system. 

MR  J  can  provide  the  statistics  and  indices  that  are  essential  to  a  hospital's 
medical  record  department.  Therefore,  it  v^as  reasonable  to  assume  thatMR^  had 
the  quantity  and  quahty  of  utilization  data  at  least  equal  to  that  of  the  manually 
produced  information  it  replaced.  The  real  test  of  MR^  was  considered  to  be  how 
it  would  be  used  as  a  data  resource  by  agencies  outside  the  hospital.  It  has  been 
used  by  the  Regional  Medical  Program,  the  Hospital  Council  of  Northern 
Cahfomia,  the  Cahfomia  Society  of  Internal  Medicine,  and  the  State  Health 
Department. 

A  planned  objective  of  MR^  was  to  acquire  data  on  every  hospitalization  in 
short-term  general  hospitals  in  California.  The  simplest  way  to  achieve  that 
objective  would  be  to  have  each  of  the  600  or  so  hospitals  in  California  join  MR^ , 
but  this  was  considered  to  be  completely  unrealistic.  There  will  always  be  a 
significant  number  of  hospitals  for  which  an  alternative  method  of  operating 
medical  records  procedures  is  more  palatable.  The  following  are  three  classes  of 
other  medical  records  systems  that  were  considered  to  be  competitive  but  had 
chances  being  assimulated  them  into  the  overall  data  gathering  objectives  of  MR^ : 

•  Commercial  systems 

•  Hospital-designed  systems 

•  PAS 

Another  problem  area  that  has  plagued  MR^  is  the  classification  of  diseases 
and  operations.  This  is  considered  to  be  a  prime  example  of  the  difficulty  at 
arriving  at  a  uniform  acceptable  classification  and  definition  of  data.  The  revisions 
of  the  ICDA  and  the  development  of  H-ICDA  by  CPHA  has  produced 
overwhelming  problems  in  coding  for  MR^ .  At  one  point  in  time  there  were  three 
different  divisions  of  ICDA  being  used  in  California.  In  general  it  was  felt  that 
H-ICDA  was  better  for  use  in  hospitals  but  not  enough  to  warrant  the  division 
caused  by  CPHA's  independent  action. 

Aside  from  the  professional  health  data  use  (planners,  epidemiologists,  other 
researchers)  there  were  three  types  of  health  professionals  that  MR^  sought 
to  become  involved  in  their  efforts.  They  were: 
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•     Hospital  administrators 


•  Medical  record  librarians 

•  Physicians 

It  was  felt  that  unless  CHDC  was  seen  by  these  health  professionals  as  an 
agency  operated  by  and  for  them,  it  had  little  hope  of  success  no  matter  how 
sophisticated  the  information  systems  might  become. 

Although  MRj  never  lacked  the  philosophical  foundation  or  theoretical 
justification  for  its  activities,  there  came  the  time  when  it  reached  the  obstacles  of 
operational  realities.  It  went  through  a  serious  crisis  when  the  service  bureau  fell 
behind  schedule  in  making  the  MR^  system  operational.  This  experience 
convinced  CHDC  that  the  mode  of  operation  —  contracting  for  programming  and 
data  processing  —  is  subject  to  too  many  problems  to  be  feasible  on  a  permanent 
basis.  It  was  viewed  that  a  system  like  MR^  would  require  its  own  staff  and  its 
own  computer  center  to  do  the  job  adequately.  There  were  several  conclusions 
developed  by  CHDC  that  are  worth  mentioning.  They  concern  localized  systems, 
uniformity  of  data,  universal  participation,  the  role  of  CPHA,  and  the  role  of 
government  agencies. 

CHDC  feels  that  medical  record  information  systems  should  be  operated  at  a 
local  level,  if  possible.  They  view  HUP  as  a  prime  example  of  involving  local 
health  professionals  as  both  beneficiaries  and  benefactors  of  a  local  health  data 
system.  CHDC  is  convinced  that  this  type  of  involvement  is  much  more  relevant 
to  a  system's  actual  impact  in  hospitals  than  is  the  data  content  of  the  system  or 
details  of  the  information  display. 

While  taking  the  stand  that  health  data  systems  should  be  localized,  CHDC 
did  not  attempt  to  attain  uniformity  across  the  nation  by  using  the  same  case 
abstracts  and  computer  system.  CHDC  was  of  the  opinion  that  the  proper 
approach  should  arrive  at  a  precise,  uniformly  accepted  definition  of  essential 
data  items.  Although  the  existing  medical  record  abstract  systems  show  a  high 
level  of  commonality  with  respect  to  data  content,  there  is  still  the  problem  area 
of  coding  for  diagnoses  and  operations.  Besides  the  complex  issues  relating  to 
coordination  of  existing  medical  records  systems,  there  will  remain  the  ever 
present  problem  of  hospitals  still  using  manual  methods  for  handling  medical 
records  information  which  consequently  is  inexcessible  to  current  information 
systems.  CHDC  took  the  stand  that  all  hospitals  should  have  the  availability  of 
some  form  of  automation  for  medical  records  information. 
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CPHA  is  now  the  only  organization  with  aspirations  to  operate  medical 
record  systems  nationally.  It  is  in  a  unique  position  to  act  as  the  national 
clearinghouse  of  data  from  regional  medical  record  systems  such  as  HUP,  QUEST, 
HSD-W  and  MR^ .  If  the  CPHA  were  to  perform  this  function  two  requirements 
would  have  to  be  filled  by  the  regional  systems: 

•  Certain  data  would  need  to  be  established  according  to  uniform 
definitions  (in  specific  magnetic  tape  format) 

•  Money  to  support  the  cost  of  acting  as  a  national  data  bank. 

This  would  require  a  significant  shift  in  role  for  CPHA  to  becoming  primarily 
a  coordinator  for  the  local  programs  rather  than  the  service  organization  for 
individual  hospitals  on  a  national  basis. 

Input  would  also  be  needed  from  government  agency  representatives 
regarding  what  they  view  as  a  desirable  role  of  these  developments.  CHEXH  has 
suggested  that  government  agencies  provide  financial  and  technical  assistance  for 
the  implementation  of  local  health  information  systems  with  the  following  three 
contingencies: 

•  The  local  system  would  need  to  be  operated  within  an  organizational 
structure  broadly  representative  of  the  interests  in  the  health  field. 

•  Commitment  to  participate  on  the  part  of  local  area  hospitals  and  other 
health  facihties  as  might  be  included  in  the  information  system  to  be 
implemented.  Commitment  to  participate  would  include  sharing  costs 
of  the  operational  system. 

•  The  local  system  would  include  certain  standard  data  items  and  there 
would  be  agreement  to  supply  these  data  to  authorized  state  and/or 
national  data  banks. 

7.  Connecticut  Utilization  and  Patient  Information  System  (255) 

The  Connecticut  Utilization  and  Patient  Information  System  (CUPIS)  is  an 
interactive,  regional  health  data  system  whose  purpose  is  to  collect,  process, 
analyze,  and  distribute  comprehensive  inpatient  medical  care  statistics  to 
hospitals,  other  health  care  facihties  providing  direct  health  care,  and  to  agencies 
that  are  involved  in  the  planning,  financing,  administration,  and  research  of  the 
current  health  delivery  system  (Connecticut  Regional  Medical  Program,  Connecti- 
cut Hospital  Association,  Connecticut  Hospital  Planning  Council,  Connecticut 
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Blue  Cross,  Connecticut  Health  Department).  An  integral  part  of  this  service  will 
be  the  continuous  consultation  provided  by  the  CUPIS  staff  to  medical  and 
hospital  administrative  staffs  and  other  appropriate  personnel  of  regional  clients. 

CUPIS  is  attempting  to  cover  the  35  hospitals  in  the  state  of  Connecticut 
and  at  the  moment  is  operational  in  approximately  seven  hospitals.  The  basic 
input  into  the  system  is: 

•  A  copy  of  the  hospital's  own  admission  form 

•  A  copy  of  the  patient's  bill 

•  A  discharge  abstract  developed  specifically  to  coincide  with  the  order 
of  the  hospital's  medical  record 

The  CUPIS  computer  program  system  is  specifically  designed  for  peer 
review,  not  only  with  regard  to  utilization  and  cost  statistics  but  with  regard  to 
quality  evaluation.  It  is  similar  to  PAS-MAP  with  the  exception  that  it  contains 
the  patient's  hospital  biUing  data  and  demographic  data  with  regard  to  the 
particular  service  population  covered  by  the  hospital.  Although  fiscal  controls  are 
part  of  the  package,  the  ultimate  goal  is  improvement  of  the  quality  of  medical 
care  through  professional  education  and  self-regulations  conduct. 

CUPIS  provides  the  following  types  of  service: 

•  Institutional  Services 

CUPIS  provides  utilization  review  exception  reports  which  are  based  on 
the  Basic  Utilization  Review  Program  (BURP).  These  reports  identify 
cases  which  may  profitably  be  reviewed  by  physicians  on  the 
appropriate  committee  of  the  medical  staff.  Diagnostic-specific  reports, 
presented  in  graphic  form,  are  distributed  as  well  as  health  care  indices, 
reports  and  analyses.  These  reports  allow  the  medical  staffs  and  the 
administration  of  each  facility  to  be  aware  of  the  patterns  of  care  that 
exist  within  the  facility,  and  to  be  able  to  compare  these  patterns  with 
other  comparable  facilities  within  the  state.  CUPIS  has  the  capability  to 
allow  facilities  to  have  direct  access  to  their  own  data  to  review  their 
facility's  performance.  Special  studies  will  be  undertaken  to  provide 
facilities  with  additional  types  of  analyses. 
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•     Regional  Services 


Regional  clients  are  provided  with  information  and  reports  which  can 
serve  as  the  basis  for  regional  planning,  program  evaluation  and  special 
studies.  These  reports  would  include  patient-centered  statistics  which 
reflect  the  utilization  of  facilities.  It  will  primarily  permit  regional 
clients  to  accurately  plan  new  programs  and  evaluate  and  amend 
existing  programs.  In  addition,  no  information  concerning  individual 
patients  will  be  distributed  to  regional  clients. 

As  with  HUP,  the  CUPIS  staff  works  closely  with  participating  facilities  to 
assure  the  accuracy,  correctness,  and  reliabihty  of  the  input  information,  as  well 
as  regularly  consulting  with  the  medical  staff  and  administration  to  interpret  the 
meaning  of  the  reports  and  analyses  and  to  assist  them  in  comparing  their 
performance  with  other  comparable  facilities  in  the  state. 

CUPIS  provides  indices  and  Hstings  that  can  be  used  by  the  medical  staff  for 
reference  as  well  as  for  fulfillment  of  JCAH  requirements.  It  provides  the 
following  types  of  indices  and  listings  on  a  semi-annual  basis: 

•  Diagnosis  cross-index 

•  Physician  listing 

•  Operative  index 

•  Surgeon  listing 

•  Newborn  listing 

•  Death  Usting 

•  Pathology  index 

•  General  patient  information 

The  service  report  of  CUPIS  is  designed  for  use  both  by  the  medical  staff  and 
hospital  administration.  The  first  few  pages  of  the  report  include  an  age  analysis, 
consultation  analysis,  multiple  diagnoses  and  surgical  analysis  for  the  entire 
hospital  as  well  as  for  each  service.  These  service  reports  are  provided  on  a 
quarterly  basis  and  the  remainder  of  the  report  contains  for  all  services  and  for 
each  service  in  the  hospital  an  analysis  of: 
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•  Admissions  —  including  type  of  admission 

•  Discharges  -  including  where  a  patient  was  discharged  to 

•  Admission  by  day  of  the  week  —  including  the  type  of  admission,  and 
the  day  of  surgery  (if  appropriate) 

•  Quality  of  care  rates  —  including  consultation  rate,  infant  death  rate, 
maternal  death  rate,  prematurity  rate,  post-op  infection  rate,  etc. 

An  integral  part  of  the  CUPIS  system  is  a  program  known  as  the  Basic 
Utilization  Review  Program  (BURP)  which  is  designed  to  improve  the  manner  in 
which  patient  care  evaluation  is  carried  out  by  the  hospital  committees.  This  is 
accompUshed  by:  (a)  selecting  cases  which  have  high  probability  of  requiring 
review,  and  (b)  evaluating  these  cases  to  determine  the  appropriateness  of  services 
(quality  of  care),  appropriateness  of  admission,  timeliness  of  discharge.  BURP's 
approach  is  to  put  the  patient  population  into  diagnostic  categories  which 
account  for  a  significant  portion  of  the  hospitalized  population.  Within  each 
diagnostic  category,  groups  of  patients  are  created  according  to  secondary 
diagnosis,  surgical  procedures,  age  and  sex.  Each  diagnostic  category  has  the 
unique  list  of  secondary  diagnosis,  surgical  procedures,  and  age  groupings  that  can 
affect  the  treatment  or  the  amount  of  time  required  for  the  treatment.  The 
hypothesis  is  that  patients  that  have  the  same  characteristics  should  therefore 
exhibit  the  same  patterns  of  care.  For  a  specific  diagnosis,  patients  with  the  same 
secondary  diagnoses,  surgical  procedures,  age  and  sex  should  require  the  same 
type  and  amount  of  services,  and  should  remain  in  the  hospital  approximately  the 
same  amount  of  time.  Those  patients  whose  stay  and/or  amount  of  services  are 
different  from  others  in  the  group  are  considered  unusual  enough  to  warrant 
review  of  the  care  received. 

The  two  parameters  being  used  to  identify  cases  which  have  a  high 
probability  of  requiring  review  are:  (a)  length  of  stay  and  (b)  the  dollar  volume  of 
special  services  per  day  (a  variable  for  the  intensity  of  the  treatment).  For  each 
homogeneous  group  there  can  be  established  an  acceptable  range  of  stay  —  a  case 
that  remains  longer  than  "X"  days  or  shorter  than  "Y"  days  would  be  identified 
for  review  by  the  medical  staff.  Limits  have  also  been  established  for  the  dollar 
volume  of  special  services  per  day.  A  probability  sample  can  also  be  taken  from 
within  the  acceptable  range  estabUshed  for  each  homogenous  group.  This  sample 
is  weighted  to  permit  more  cases  to  be  identified  from  the  area  close  to  the  limits 
than  from  the  center  of  the  distribution.  When  these  cases  are  reviewed  it  is 
possible  to  determine  whether  the  limits  are  valid  and  what  portion  of  the  cases 
presumed  to  be  acceptable  actually  were  judged  to  be  inappropriate. 
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This  can  be  described  as  Type  II  error.  Once  cases  have  been  identified  for 
review,  the  physicians  from  the  responsible  medical  staff  committee  evaluate 
these  cases  to  determine  the  appropriateness  of  services,  the  appropriateness  of 
the  admission,  and  the  timeliness  of  the  discharge.  It  is  imperative  that  the  results 
of  the  physician  evaluations  be  regularly  sent  back  to  the  CUPIS  staff.  This  type 
of  feedback  from  the  physicians  allows  the  CUPIS  staff  to  make  any  revisions  in 
the  groups  and/or  in  the  limits  in  order  that  cases  with  a  high  probability  of 
needing  review  will  continue  to  be  identified  by  the  screening  program. 

The  diagnosis  report  is  dependent  upon  BURP.  For  each  diagnostic  category 
used  in  the  BURP  program  and  for  each  homogenous  group  of  patients  within  the 
diagnostic  category  defined  by  the  BURP  program,  information  is  generated  by 
comparing  the  hospital  with  state  figures.  These  comparisons  are  made  with 
regard  to  length  of  stay  and  the  dollar  value  of  special  services  per  day.  The 
diagnostic  categories  are  comprised  of  patients  with  specific  discharge  diagnoses, 
secondary  diagnoses,  surgical  procedures,  age  and  sex.  Bar  graphs  are  generated  to 
depict  the  percent  of  patients  with  the  diagnosis-specific  category  which  had  each 
discharge  diagnosis,  secondary  diagnosis,  surgical  procedures,  age  group  and  sex. 

After  a  homogenous  group  of  patients  has  been  defined,  graphs  are  created 
to  show  the  length  of  stay,  and  the  dollar  volume  of  special  services  per  day. 
These  graphs  are  used  as  reference  in  an  attempt  to  understand  the  pattern  of  care 
for  a  particular  homogenous  group  of  discharges  from  a  hospital  as  well  as  for 
similar  patients  discharged  from  Connecticut  hospitals.  Patients  whose  length  of 
stay  or  special  services  per  day  are  on  the  extreme  ends  of  the  distribution  will  be 
identified  in  the  exception  reports. 

The  homogenous  groups  of  patients  defined  by  the  BURP  program  and 
graphically  presented  in  the  diagnosis  reports  are  composed  of  patients  who  are 
expected  to  show  similar  patterns  of  care.  Any  patient  whose  length  of  stay  or 
dollar  volume  of  special  services  per  day  is  different  from  others  in  the  group,  is 
identified  in  the  exception  report.  Limits  are  established  which  are  used  to 
identify  patients  whose  stay  or  volume  of  special  services  per  day  was  greater  than 
"X"  or  less  than  "Y".  A  weighted  sample  from  within  the  acceptable  range 
established  for  each  homogenous  group  is  also  included  in  the  exception  report. 

Three  types  of  patients  identified  in  the  exception  reports  are: 

•  Long  length  of  stay  or  special  services  per  day 

•  Short  length  of  stay  or  special  services  per  day 

•  Normal  length  of  stay  or  special  services  per  day. 
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CUPIS  is  presently  funded  by  the  present  contract  with  the  Connecticut 
Regional  Medical  Program  which  has  been  under  way  since  December,  1971.  The 
two  previous  years  of  development  were  also  funded  by  the  CRMP. 

8.  Blue  Cross  Data  System  (96) 

The  Massachusetts  Blue  Cross  Data  System  (BCDS)  is  now  defunct  and  was 
superceded  by  the  Massachusetts  Hospital  Association  Utilization  Information 
Service.  BCDS  was  primarily  constituted  to  provide  an  orderly  system  for 
hospitals  to  analyze  utilization  of  facilities  and  to  compare  such  utilization  with 
other  institutions.  Data  were  provided  in  simple  formats  and  supported  by 
continued  field  contact.  Before  ceasing  operation,  this  regional  program  covered 
approximately  35  hospitals  in  the  state  of  Massachusetts.  The  basic  input 
document  was  an  abstract  of  the  medical  record  for  each  discharged  patient.  The 
data  base  encompassed  patient  identification  and  social  characteristics,  diagnosis 
and  procedure  information,  and  service  and  planning  data.  The  reports  generated 
included  a  series  of  monthly,  quarterly,  and  semi-annual  Ustings,  indices, 
summaries,  analyses  and  comparative  reports.  The  reports  generated  included: 

Monthly  Reports 

•  Diagnosis  listing 

•  Operation  Usting 

•  Death  Hsting 

•  Discharge  analysis 

Periodic  Reports  (Quarterly,  Semi- Annual) 

•  Physician  index 

•  Diagnosis  index 

•  Operation  index 
Semi-Annual  Comparative  Reports 

•  Length  of  stay  distribution  by  days 

•  Pre-operative  stay 
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Hospital  ranking 


•  Analysis  by  day  of  week  of  admission 

Special  Reports  and  Studies  on  Request 

9.  Utilization  Information  Service  of  the  Massachusetts  Hospital  Association 
(164) 

The  MHA  Utilization  Information  Service  (UIS)  is  a  computerized,  shared 
medical  record  abstract  system  which  provides  summaiy  information  about  the 
individual  patients  and  episodes  of  illness.  This  service  has  aided  hospital  medical 
and  administrative  staffs  in  fulfilling  their  obUgations  to  conduct  retrospective 
case  reviews.  Utilization  review  information  is  provided  through  standard  and 
special  reports.  Currently  the  service  produces  the  following  standard  reports: 

Monthly  Reports 

•  Diagnosis  listing 

•  Operation  listing 

•  Death  listing 

•  Discharge  analysis 

•  Diagnosis  summary 

•  Operation  summary 
Semi-Annual  Reports 

•  Diagnostic  cross-index 

•  Operation  cross-index 

•  Physician  and  surgeon  cross-index 

•  Discharge  analysis 

•  Operation  summary 

•  Diagnosis  summary 
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In  addition  to  performing  its  primary  function  of  assisting  the  hospitals  in 
utilization  review,  the  utilization  information  service  provides  other  services  to 
improve  the  operation  of  the  medical  record  department  and  assist  in  controlling 
costs  by  eliminating  repetitive  clerical  functions.  The  service  provides,  as  part  of 
the  regular  reports,  a  series  of  diagnosis  and  operation  indexes  and  cross-indexes 
which  satisfy  the  requirements  of  the  Joint  Commission  on  Accredication  of 
Hospitals  and,  thereby,  eliminate  the  time  consuming  and  frequently  inaccurate 
process  of  manual  creation  of  these  indexes. 

UIS  also  provides  the  participating  hospitals  with  the  information  necessary 
to  complete  the  periodic  reports  required  by  various  governmental  and  planning 
agencies  such  as  the  Hill-Burton  studies  conducted  by  the  Department  of  PubUc 
Health,  and  studies  conducted  by  various  planning  agencies. 

In  the  preparation  of  these  reports,  large  quantities  of  data  have  been 
accumulated.  At  the  present  time  there  are  more  than  500,000  records  in  the  data 
bank  and  approximately  39,000  records  currently  being  added  each  month.  With 
this  data  bank  UIS  is  able  to  perform  any  specialized  utilization-related  studies  for 
participating  hospitals,  individually  and  collectively.  Some  of  the  studies 
accomplished  to  date  are: 

•  Readmission  rate  of  patients 

•  Short-stay  cases 

•  Number  of  patients  and  patient  days  by  payment  status 

•  Physician  use  of  facility 

•  Hospital  used  by  patient,  resident,  location 

•  Data  for  reporting  to  governmental  and  accrediting  agencies 

•  Number  of  emergency  admissions 

•  Number  of  diagnostic  admissions 

•  Identification  of  patient 

•  Use  of  special  care  units 

•  Need  for  additional  or  elimination  of  specialty  services 
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•  Comparison  with  other  hospitals  by  similar  type,  size,  geographic  area 

•  Special  medical  audit  data 

®     Identification  of  ten  most  common  diagnoses  and  operations 

UIS  has  been  designed  and  implemented  to  insure  that  the  participating 
hospitals  control,  understand  and  utilize  this  system.  The  hospitals  maintain 
control  through  management,  medical  advisory  and  medical  record  administrative 
committees. 

UIS  staff  are  experienced  in  records  analysis,  and  provide  continuous 
support  and  consultation  to  hospital  administration,  utilization  review  commit- 
tees, physicians,  and  medical  records  administrators.  This  staff  support  assures 
that  participating  hospitals  fully  understand  the  system's  capability,  achieve 
timely  submission  of  complete  and  accurate  data,  and  make  maximum  use  of  the 
reports  furnished.  The  UIS  staff  also  maintains  close  liaison  with  the  Department 
of  Public  Health  and  other  agencies  to  assist  hospitals  in  effectively  satisfying 
their  legal  reporting  requirements,  to  insure  that  other  utilization  related 
surveys/ information  needs  of  such  agencies  are  fully  coordinated  under  the  UIS 
activity,  and  to  avoid  duplication  of  effort. 

A  brief  description  of  each  report  follows: 

•  Diagnosis  Listing 

This  document  presents,  in  digested  form,  the  relevant  information  for 
each  abstract.  All  cases  for  the  period  are  Usted  in  order  by  primary 
diagnosis.  The  highlights  of  the  printed  format  are: 

—  Six  diagnoses 

—  Four  operations 

—  Four  physicians 

—  Medical  record  number 

—  Age 

—  Sex 

—  Origin 

—  Admission  date 

—  Admission  status  (emergency,  elective,  urgent) 

—  Discharge  status  indicating  alive  or  dead,  coroners'  cases,  transfer 
to  another  institution,  autopsy,  post-operative  death 

—  Hospital  service 

—  Number  of  consultations 
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—  Length  of  stay 

—  Pre-operative  stay 

—  Special  Studies 

•  Operation  Listing 

All  case  abstracts  for  the  period  containing  operative  procedures  are 
listed  in  this  report,  in  primary  operation  code  order.  Each  group  of 
related  operations  are  distinguished  by  a  descriptive  title  and  a  total 
denoted  by  an  asterisk  for  each  primary  operation  code  is  provided. 

•  Listing  of  Deaths 

Each  abstract  relating  to  patients  who  died  during  the  period  are 
presented  here,  and  are  grouped  into  four  categories.  The  categories 
are:  deaths  not  autopsied,  deaths  autopsied,  coroners'  cases  not 
autopsied,  coroners'  cases  autopsied.  Total  of  cases  in  each  category  is 
displayed. 

•  Diagnosis  Summary 

This  report  summarizes  the  data  presented  in  the  diagnosis  listing.  A 
feature  of  the  report  is  the  selection  of  two  study  groups.  The  first 
study  group  excludes  cases  resulting  in  death  or  discharge  against 
medical  advice,  and  cases  whose  length  of  stay  exceeds  99  days.  The 
second  group  comprises  a  selection  of  patients  who  experienced 
operative  procedures.  Excluded  from  this  group,  in  addition  to  the 
previously  cited  exclusions,  are  diagnostic  procedures,  radiotherapy  and 
other  selected  operations. 

•  Operation  Summary 

This  report  summarizes  the  data  presented  in  the  operation  listing.  One 
study  group  is  presented  and  excludes  cases  whose  primary  operation 
code  represents  a  diagnostic  procedure,  radio-therapy,  or  selected 
operations.  Also  excluded  are  cases  resulting  in  death  or  discharge 
against  medical  advice,  and  cases  whose  length  of  stay  exceeded  99 
days. 
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•     Discharge  Analysis 


This  report  presents  discharge  by  service,  discharge  days  and  average 
stay  with  breakdowns  by  age  groupings,  admission  and  discharge  status. 
Also  provided  are  totals  for  adult,  pediatric  and  newborn  patients. 
Additional  data  is  displayed  on  transfers,  unusual  deaths,  rates  on 
deaths,  autopsies  and  consultations,  percentage  of  admissions  and 
discharges  by  day  of  week,  patient  origin,  and  use  of  special  care  units. 

•  Diagnosis  Index 

This  index  in  a  cumulative  report  of  all  cases  for  a  six  month  period. 
Diagnoses  are  listed  in  primary  order  and  are  immediately  followed  by 
those  cases  for  which  the  same  diagnosis  is  reported  as  an  associated  or 
secondary  condition. 

•  Operation  Index 

This  six  month  cumulative  report  lists  all  cases  on  which  surgical 
procedures  were  reported.  Primary  operations  are  listed  by  category, 
and  are  followed  by  those  cases  having  the  same  operation  recorded  as 
secondary  procedures. 

•  Physician  Cross-Index 

All  cases  for  the  period  are  listed  in  physician/ surge  on  code  number 
order.  The  cases  are  further  grouped  into  four  categories: 

—Cases  in  which  the  doctor  was  attending  physician 
—Cases  in  which  he  was  associated  as  other  physician 
—Cases  in  which  he  was  principal  surgeon 
—Cases  in  which  he  was  associated  as  other  surgeon 

The  total  number  of  patients,  patient  days,  average  stay  per  patient, 
number  of  expired  patients,  consultations  and  consultation  rate,  are 
provided  for  each  category  additionally.  The  average  pre-operative  stay 
is  provided  for  each  of  the  groupings  by  surgeon. 

•  Semi-Annual  Comparative  Report 

This  report  provides  a  ranking  with  other  hospitals  by  length  of  stay. 
Rankings  are  done  by  the  following  categories: 
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—  Diagnosis 

—  Operation 

—  Comparison  with  previous  six-month  experience 

The  report  also  provides  ranking  with  other  hospitals  by  length  of  stay 
within  the  day  of  week  the  patient  was  admitted.  Rankings  are  cate- 
gorized by: 

—  Pre-op  stay  within 

—  Day  of  week  admitted 

•     Length  of  Stay  Criteria 

Under  the  UIS  system  each  hospital  may  set  its  own  parameter  for: 

—  Short  stay  patients 

—  Long  stay  patients 

The  criteria  is  based  on  diagnoses  and  may  be  useful  for  selecting  cases 
for  the  utiUzation  review  committee.  The  length  of  stay  report  displays 
the  total  number  of  patients  with  certain  diagnoses  for  the  period.  It 
highlights  the  number  of  patients  who  fall  below  the  hospital's  previously 
selected  criteria  for  short-stay  patients  as  well  as  the  number  of  patients 
who  have  lengths  of  stay  longer  than  the  hospital's  long-stay  criteria.  The 
diagnoses  to  be  studied  are  determined  by  the  hospital  staff.  The  UIS 
program  management  consists  of  the  following  committees: 

•  Management  Committee  composed  of  participating  hospitals 

•  Medical  Advisory  Committee  composed  of  utilization  review  physi- 
cians of  participating  hospitals. 

•  Participating  Advisory  Committees 

A  technical  advisory  committee  was  created  by  the  Management  Commit- 
tee and  consists  of  medical  record  librarians  of  participating  hospitals,  and 
chairman  of  the  UR  committee  in  participating  hospitals.  These  commit- 
tees may : 

•  Approve  design  of  future  reports 

•  Devise  existing  reports 

•  Suggest  length  of  stay  criteria 
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10.  Relative  Stay  Index  (RSI)  of  the  Ontario  Hospital 
Services  Commission  (201 ) 

The  Relative  Stay  Index  (RSI)  is  a  number  which  states  the  percentage  by 
which  a  group  of  hospital  patients  stay  a  longer  or  shorter  time  in  a  hospital  than 
would  be  expected.  It  may  be  referred  to  as  an  "index  number,"  and  its  construction 
is  similar  to  the  cost  of  living  index.  RSI  can  be  computed  for  any  group  of  hospital 
patients  who  are  associated  with  one  another  in  some  way ;  for  example,  there  could 
be  patients  who  use  the  same  hospital  or  have  the  same  doctor,  or  live  in  the  same 
community. 

The  estimate  of  how  long  patients  are  expected  to  stay  in  hospitals  is  made  by 
comparing  the  experience  of  a  group  of  patients  under  consideration  with  the  expe- 
riences of  a  much  larger,  but  similar,  group  of  patients.  The  experience  of  this  larger 
group  of  patients  provides  norms,  or  standards,  against  which  a  target  group  of  pa- 
tients is  compared.  Therefore,  the  norms  depend  on  the  group  of  patients  which  are 
selected  to  serve  as  the  reference  group.  The  Ontario  Hospital  Services  Commission 
has  developed  an  RSI  for  each  hospital  in  a  group  of  public  general  hospitals,  using 
the  experience  of  the  patients  who  were  discharged  during  a  particular  year.  The 
grouping  of  hospitals  is  on  the  basis  of  bed  size  and  teaching  affiliations.  The  norms, 
which  the  patients  in  a  given  hospital  are  compared  against,  are  provided  by  the 
experience  of  all  similar  patients  discharged  from  all  hospitals  in  the  group. 

The  important  feature  of  the  RSI  is  that  patients  are  classified  as  being  differ- 
ent types,  so  that  only  patients  of  the  same  type  are  compared  with  each  other.  If  the 
patients  were  not  categorized  in  any  way  at  all,  then  one's  patient  experience  would 
be  compared  with  the  experience  of  all  patients;  this  results  in  comparing  the  "raw" 
length  of  stay  of  various  hospitals  with  each  other.  It  is  extremely  unlikely  that  com- 
parisons of  average  length  of  stay,  which  do  not  take  into  account  patient  mix,  have 
any  meaning.  In  putting  forward  the  RSI,  the  fundamental  position  of  the  Ontario 
Hospital  Service  Commission  is  that  useful  comparisons  cannot  be  made  until 
account  is  taken  of,  at  least,  age,  sex,  and  diagnosis  mix  of  hospital  patients. 

The  RSI  takes  into  account  differences  among  patients  by  classifying  them  by 
different  types.  The  classification  scheme  which  is  used  cannot  be  regarded  as  ideal; 
since  it  suffers  from  limitations  which  arise  for  the  following  reasons: 

•  Limitations  imposed  by  the  data  based  on  the  way  in  which  patients  can 
be  classified. 

•  Technical  limitations  imposed  by  computer  resources  which  are  available 
to  the  project. 
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•  Kinds  of  arbitrary  choices  about  classification  which  are  required  to  get  a 
project  of  this  type  under  way. 

For  each  hospital,  a  separate  RSI  is  constructed  for  each  broad  classification  of 
disease  which  are  combined  to  form  an  overall  RSI  hospital.  Any  RSI  can  be  judged 
as  falling  into  one  of  the  following  three  categories: 

•  The  RSI  is  low;  i.e.,  on  the  average,  most  of  the  patients  remain  a  signi- 
ficantly shorter  period  of  time  in  the  hospital  than  would  be  expected;  or, 

•  The  RSI  is  high,  i.e.,  on  the  average,  patients  remain  a  significantly  longer 
period  of  time  in  the  hospital  than  would  be  expected;  or, 

•  That  the  hospital's  patients  do  not  differ  significantly  from  the  expected 
length  of  time,  i.e.,  any  differences  which  can  be  observed  can  be  regarded 
as  a  chance  variation. 

An  important  issue  here  is  how  the  RSI  may  be  interpreted.  Are  low  RSI's 
desirable?  Are  high  RSI's  undesirable?  Hospitals  in  Canada  find  themselves  in  differ- 
ing circumstances  but,  other  things  being  equal,  prefer  shorter  lengths  of  stay  to 
longer  lengths  of  stay.  However,  there  may  be  shortages  of  extended  care  facilities  in 
some  areas,  making  it  difficult  to  discharge  certain  types  of  patients.  Home  care  pro- 
grams may  not  exist  in  some  communities.  Patients  may  come  from  remote  or  med- 
ically isolated  areas,  which  result  in  doctors  being  reluctant  to  discharge  such 
patients  as  early  as  they  otherwise  might.  Extenuating  circumstances  can  exist,  and 
before  labels  of  "good  or  bad"  can  be  attached  to  RSI's,  these  types  of  circum- 
stances are  evaluated. 

Conversely,  the  Ontario  Hospital  Services  Commission  recognizes  that  high 
RSI's  can  be  observed  without  extenuating  circumstances.  In  these  cases,  a  high  RSI 
indicates  situations  in  which  admission  and  discharge  committees  are  not  working 
effectively  or  it  may  identify  situations  in  which  the  scheduling  of  patients  is  poor, 
or  it  may  be  symptomatic  of  situations  in  which  a  hospital  is  not  using  its  resources 
effectively. 

A  hospital's  RSI  for  a  particular  diagnosis  category,  or  for  the  hospital  as  a 
whole,  may  provide  evidence  that  the  hospital's  performance  is  significantly 
poorer  than  the  performance  of  other  comparable  hospitals.  Such  a  finding, 
should  lead  the  hospital  to  inquire  whether  its  length  of  stay  performance  can  be 
improved.  The  usefulness  of  the  RSI  is  that  it  provides  gross  information  which 
indicates  to  a  hospital  any  unusual  features  in  length  of  stay  which  might  be 
regarded  as  "symptomatic." 
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Once  a  problem  is  identified,  however,  the  RSI  offers  Httle  diagnostic 
guidance.  To  fill  this  diagnostic  gap,  the  Commission  has  recently  published 
Ontario  Length  of  Stay  Tables:  1969-71.  The  purpose  of  this  new  companion 
publication  to  the  RSI  report  is  to  provide  detailed  information  which  will  be 
useful  to  the  hospital  for: 

•  Detailed  retrospective  examination  of  the  hospital's  length  of  stay 
experience. 

•  Ongoing  evaluation   of  the   experience   of  patients  of  individual 
physicians  or  groups  of  physicians. 

•  Admission  and  discharge  scheduHng  of  patients. 

It  is  the  information  and  methods  contained  in  the  length  of  stay  tables 
which  are  used  to  diagnose  one  of  the  specific  problem  areas.  The  RSI  report  is 
presented  in  order  that  hospitals  can  identify  general  problem  areas  by  the 
comparison  of  their  performance  with  that  of  other  similar  hospitals. 

The  latest  addition  of  the  RSI  (done  in  1971)  presents  a  series  of  tables 
preceded  by  an  introductory  section  which  explains  the  derivation  and  interpreta- 
tion of  the  tables.  There  are  six  different  versions  of  the  RSI  report,  each  relating 
to  a  different  group  of  public  general  hospitals  in  Ontario.  In  each  version,  the 
tables  relate  to  the  experience  of  the  hospitals  in  the  group,  but  the  introductory 
material  is  common  to  all  versions. 

The  introductory  section  of  the  RSI  is  concluded  by  four  summary  tables 
which  present  the  experience  concerning  some  aspect  of  the  average  length  of  stay 
of  RSI  of  all  hospitals  in  the  group,  and  then  show  the  experience  of  all  hospitals 
in  the  six  groups  for  the  same  aspect. 

In  the  next  section  of  the  book  there  are  detailed  tables  listed  for  each 
hospital  in  the  group.  For  each  hospital,  there  are  three  different  RSI  tables  and  a 
five-year  summary  table. 

•  The  1971  RSI  table  shows  the  most  recent  experience  of  the  hospital. 

•  The  1970  RSI  table  is  included  so  the  hospital  can  compare  its  most 
recent  experience  with  the  experience  of  the  previous  year. 
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•  The  1969-71  RSI  table  combines  the  experience  of  the  three  most 
recent  years  so  that  the  hospital  can  obtain  a  longer-term  perspective  of 
its  experience 

•  The  five-year  summary  table  presents  summary  statistics  since  1967. 

The  last  section  of  the  RSI  report  contains  42  diagnosis  tables.  The  first  of 
these  tables  combines  a  hospital's  experience  with  all  diagnosis  categories,  and 
shows  the  overall  or  total  experience  of  each  hospital  in  the  group.  This  is 
followed  by  similar  tables  for  each  of  the  41  diagnostic  groupings  used  in 
developing  the  overall  RSI. 

These  tables  are  included  so  that  a  hospital  can  readily  see  its  experience  in  a 
particular  diagnostic  area,  in  comparison  with  experience  of  other  hospitals  in  the 
group.  For  hospitals  with  100  or  more  beds,  the  diagnosis  tables  present  1971 
experience.  For  hospitals  with  fewer  than  100  beds,  the  diagnosis  tables  present 
the  combined  experience  of  1969-1971.  In  similar  hospitals  there  are  a  number  of 
diagnosis  categories  with  very  few  cases  in  one  year,  and  the  use  of  the  three  year 
experience  provides  a  better  perspective. 

The  Ontario  Hospital  Services  Commission  had  four  different  motivations  in 
developing  the  RSI  report.  They  were: 

•  The  Commission  believed  that  it  could  assist  hospitals  by  providing 
timely,  comparative  information  about  performance  and  a  variety  of 
dimensions  of  hospital  effectiveness  and  efficiency.  The  RSI  program 
was  viewed  as  an  application  of  this  principle.  The  emphasis  on 
providing  timely  information  was  expanded  in  1971  with  the  produc- 
tion of  interim  RSI  statistics  on  a  four-monthly  basis. 

•  A  second  objective  was  to  upgrade  the  level  of  discourse  about  the 
average  length  of  stay,  as  an  indicator  of  hospital  performance.  The 
average  length  of  stay  has  long  been  used  in  forming  opinions  about  the 
efficiency  of  and  the  resources  needed  by  a  hospital.  The  Commission 
recognized  that  the  average  length  of  stay  is  only  one  of  the  dimensions 
of  hospital  performance.  Although  the  average  length  of  stay  indicator 
may  be  of  little  or  no  significance  in  the  future,  the  Commission  regards 
average  lengths  of  stay  comparisons  as  a  significant  indicator  at  present. 
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•  The  third  motivation  for  the  production  of  RSI  arose  because,  within 
the  pubUc  sector,  there  was  a  search  for  indicators  which  would  be 
useful  in  assessing  the  performance  of  individual  institutions,  or 
government  programs,  be  they  hospitals,  schools,  etc.  The  RSI  can  be 
viewed  as  an  attempt  to  develop  one  such  performance  indicator  for 
hospitals.  The  Commission  has  concentrated  on  its  development  as  a 
measure  of  hospital  performance  because  much  of  the  necessary  data 
was  readily  available  and  because  the  average  length  of  stay  indicator 
was  already  in  common  use.  The  Commission  emphasized  that  the  RSI 
is  not  the  only  important  dimension  of  hospital  performance. 

•  The  final  motivation  for  the  development  of  the  RSI  arose  from  the 
financial  incentive  plan  that  was  introduced  in  March  1970  for 
hospitals  in  Ontario.  The  general  philosophy  of  the  incentive  plan  was 
that  a  hospital  which  under-expends  its  approved  financial  allotment, 
while  substantially  maintaining  its  treatment  and  rehabilitation  pro- 
grams, is  entitled  to  keep  some  part  of  that  saving.  The  Commission 
recognized,  however,  that  before  the  real  amount  of  saving  could  be 
known,  changes  in  the  volume  of  patient  care  would  have  to  be 
identified  and  adjusted. 

At  the  time  of  the  introduction  of  the  incentive  program,  measures  of  the 
change  in  volume  of  patients  still  had  to  be  developed  so  that  initially  approved 
budgets  could  be  adjusted,  and  savings  under  the  incentive  plan  could  be 
determined.  An  additional  problem  was  how  to  evaluate  the  desirability  of 
changes  in  volume.  The  introductory  statement  of  the  incentive  plan  outlined  the 
Commission  poUcies  which  would  prevail  in  the  presence  of  different  types  of 
behavior  of  patient  days,  number  of  patients,  and  length  of  stay.  At  the  time  of 
introduction,  the  statement  was  necessarily  vague,  since  the  mechanism  to  be 
more  explicit  was  lacking.  Consequently,  the  final  motivation  to  develop  the  RSI 
was  to  give  numerical  substance  to  the  general  statement  of  policy  about  volume 
under  the  financial  incentive  program. 

1 1 .  Medicare  Analysis  of  Days  of  Care  (MADOC)  of  the  Social  Security 
Administration  (173,  217) 

In  order  to  assist  hospitals  and  intermediaries  in  assessing  utilization 
patterns,  the  Social  Security  Administration  has  developed  statistics  on  how  long 
Medicare  patients  remain  in  short-stay  institutions.  Medicare  Analysis  of  Days  of 
Care  (MADOC)  began  in  the  fall  of  1970  with  the  purpose  of  collecting  data  on 
Medicare  beneficiaries.  The  first  report  (MADOC-2)  covered  hospital  discharges  in 
the  second  half  of  1969. 
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MADOC  data  identifies  hospitals  for  which  the  average  length  of  stay, 
determined  for  a  sample  of  Medicare  patients,  differs  from  an  average  estimated 
length  of  stay,  taking  into  account  the  hospital's  location,  patient  mix,  and  other 
characteristics.  Through  the  use  of  a  multiple  regression  technique,  an  equation  is 
established  for  each  geographic  area  relating  length  of  stay  to  characteristics  of 
the  area's  patients  and  hospitals.  The  equation  is  based  on  12  months  experience 
for  the  particular  geographic  area.  For  each  hospital,  an  average  estimated  length 
of  stay  is  derived  for  discharges  during  the  most  recent  six  month  period  available, 
based  on  the  area  equation  previously  estabUshed.  Each  hospital's  current 
experiences  are  compared  with  that  of  all  hospitals  in  its  area  for  the  preceding 
year. 

The  tables  in  the  MADOC  report  are  based  on  data  from  bills  for  discharges 
from  short-stay  hospitals  occurring  in  20  percent  of  the  population  65  years  of 
age  or  older  insured  under  the  hospital  insurance  portion  of  Medicare  (Part  A). 
The  sample  is  identified  by  the  individual's  health  insurance  claim  number  which 
is  entered  on  the  hospital  bill.  Only  those  bills  received  and  processed  by  SSA 
before  the  cutoff  date  for  preparing  the  report  (approximately  six  months 
following  the  reporting  period)  can  be  included.  To  the  extent  that  late  bills 
reflect  exceptional  circumstances,  the  data  will  be  affected  by  a  reporting  bias. 

For  purposes  of  the  MADOC  analysis,  hospitals  throughout  the  country  have 
been  grouped  into  275  geographic  areas.  These  areas  are  made  up  of  counties  or 
parts  of  counties  within  each  state  defined  as  the  hospital  service  area  for  the 
Hill-Burton  program,  but  modified  for  the  present  application  wherever  possible. 
They  also  conform  to  the  area  serviced  by  an  intermediary,  contain  a  minimum  of 
five  hospitals,  and  1000  beds,  and  a  maximum  of  50  hospitals.  The  areas  were 
defined  to  reflect,  among  other  considerations,  patient  origin,  availability  of 
medical  and  paramedical  manpower,  and  common  patterns  of  medical  care. 

The  variables  that  can  be  entered  into  the  regression  equation  are  limited  to 
those  on  the  hospital  bill,  the  patient  characteristics  available  to  SSA  through 
apphcation  for  a  claim  number,  and  the  hospital  characteristics  contained  on  the 
SSA  certification  form.  A  number  of  variables  known  or  thought  to  contribute  to 
explanation  of  variation  in  hospital  stays  are  not  in  the  array  of  information  at 
hand  for  study  and  cannot  be  entered  into  the  regression  equation. 

Length  of  stay  is  used  as  the  dependent  variable  in  the  regression  equation. 
The  independent  variables  are: 
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•     Primary  Discharge  Diagnosis 


The  diagnostic  variables  that  are  entered  into  the  equation  as  absent  or 
present  include  29  individual  primary  discharge  diagnoses  and  19 
clusters  of  diagnoses.  The  29  diagnoses  are  those  that  occurred  most 
frequently  in  the  sample  of  Medicare  short-stay  hospital  discharges  in 
1966.  The  clusters  of  diagnoses  were  characterized  in  the  same  sample 
of  data  by  a  similar  length  of  stay.  As  a  result  of  the  preliminary  work, 
using  joint  variables,  composite  variables  were  formed  to  reflect  special 
effects  that  were  produced  on  length  of  stay  by  the  joint  occurrence  of 
two  variables.  Consequently,  for  eight  of  the  29  diagnoses,  discharges 
with  surgery  are  treated  separately.  Another  diagnostic  variable  is  split 
up  into  discharges  reporting  this  diagnosis  only,  and  discharges  reported 
with  additional  diagnoses;  and  finally,  the  presence  of  both  additional 
diagnoses  and  surgery  is  considered  as  another  variable. 

•  Hospital  Variables 

Twelve  hospital  variables  are  used,  including  hospital  size,  measured  by 
the  number  of  adult  beds,  and  the  number  of  services  provided  by  the 
hospital.  Type  of  hospital  control  and  service  characteristics  are 
included  as  either  absent  or  present.  The  information  about  each 
hospital  is  obtained  from  forms  completed  by  the  hospital  in  its  request 
for  participation  in  the  Medicare  program. 

•  Patient  Variable 

Patient  variables  in  the  equation  are  hmited  to  age,  sex,  and  race. 

•  Treatment  Variables 

This  class  of  variables  are  intended  to  reflect  the  extent  of  treatment 
and  includes  charges  for  the  selected  ancillary  services.  These  charges 
are  also  used  as  an  indirect  measure  of  the  intensity  of  care  and  the 
severity  of  the  patient's  condition.  Whether  or  not  there  was  a  surgical 
procedure,  there  is  an  additional  variable. 
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The  semi-annual  report  package  consists  of  three  basic  tables: 

•  Table  I 

This  table  shows  the  average  length  of  stay  of  the  sample  for  all  patients 
discharged  from  each  hospital  along  with  the  average  length  of  stay  of 
Medicare  patients  discharged  from  other  hospitals  in  the  same  geo- 
graphic area.  For  each  hospital,  the  average  actual  length  of  stay  is 
compared  with  the  average  estimated  length  of  stay.  The  estimated 
figure  is  based  on  the  area  of  experience,  which  takes  into  consideration 
the  characteristics  of  the  hospital,  its  patients,  their  illnesses,  and  the 
kinds  of  treatment  received. 

•  Table  II 

This  table  distributes  the  same  discharges  whose  average  was  shown  in 
Table  I  by  length  of  stay  in  order  to  provide  a  quick  comparison  of  the 
actual  experience  in  each  hospital  with  that  of  the  other  hospitals  in  the 
area  as  a  whole. 

•  Table  III 

This  table  shows  the  actual  average  length  of  stay  for  each  hospital  with 
an  adjustment  period.  Data  by  discharge  diagnoses  are  Hmited  to  the 
ten  diagnostic  conditions  (or  groups  of  conditions)  reported  most 
frequently  as  requiring  hospitalization  in  the  United  States  among 
Medicare  patients. 

In  examining  the  average  estimated  and  actual  lengths  of  stay  in  Table  I, 
emphasis  in  making  comparisons  is  directed  solely  to  the  differences  between  the 
actual  and  estimate  for  each  hospital  rather  than  direct  comparison  of  actual  to 
actual  or  estimate  to  estimate  for  different  hospitals.  The  mix  of  cases  varies  from 
hospital  to  hospital  in  many  ways.  For  example,  a  hospital  with  actual  length  of 
stay  of  1 2  days  and  an  estimated  length  of  stay  of  1 1  days,  may  possibly  turn  out 
to  be  making  less  appropriate  use  of  hospital  beds  than  a  hospital  with  actual  stay 
of  16  days  but  with  an  estimated  stay  of  14  days,  if  the  former  figure  is  marked 
by  an  asterisk  and  the  latter  figure  is  not  marked.  Sampling  fluctuations  are  also 
taken  into  account  in  the  flagging  of  averages  in  order  that  those  so  marked  can 
be  safely  regarded  as  exhibiting  significant  deviations.  The  presence  of  an  asterisk 
warrants  hospital  staff  investigation  to  determine  the  causes  of  deviation.  Any 
institutions  could  utilize  other  sources  of  information  to  compliment  the  MADOC 
data  in  their  analysis  of  operations  to  determine  how  effectively  their  resources 
are  used. 
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In  addition  to  the  comparison  between  average  actual  and  estimated  length 
of  stays  for  a  six-month  period  in  Table  I,  the  monthly  results  for  each  hospital 
are  shown  in  terms  of  the  deviation  of  the  actual  from  the  estimated  length  of 
stay.  The  direction  of  the  deviation  is  shown,  that  is,  a  plus  sign  if  the  actual  is 
greater  and  a  minus  sign  if  it  is  less  than  the  estimate.  Actual  differences  are  not 
entered  on  a  monthly  basis  since  samphng  variability  is  much  greater  than  for  the 
six-month  period.  If  all  signs  are  alike,  consideration  should  be  given  to  the 
possibility  that  a  pattern  of  consistent  deviation  exists  which  also  warrants 
hospital  staff  investigation. 

The  number  of  variables  known  are  thought  to  contribute  to  an  explanation 
of  the  variation  hospital  days,  and  could  not  be  included  in  the  regression 
equation  since  they  simply  are  not  available  on  any  records  required  in  the 
administration  of  the  Medicare  program.  However,  a  few  variables  that  have  been 
demonstrated  to  be  related  to  length  of  stay  for  which  data  can  be  obtained,  have 
been  deliberately  omitted  from  the  regression  equation.  For  example,  length  of 
pre-operative  stay,  and  day  of  week  of  admission  or  discharge,  are  excluded.  If 
these  had  been  included,  the  estimated  length  of  stay  would  allow  for  variables 
that  are  within  the  administrative  control  of  the  hospital,  diminishing  the  value  of 
the  estimated  average  in  assessing  performance.  The  only  variables  allowed  in  the 
estimated  equation  are  those  presumed  to  be  outside  the  control  of  the  hospital. 
Therefore,  the  estimated  value  includes  the  variable  reflecting  medical  school 
affiliation,  which  constitutes  a  sixth  factor  in  determining  length  of  stay. 

The  Social  Security  Administration  has  experienced  some  data  collection 
problems  in  using  the  hospital  billing  form  SSA-1453.  One  such  problem  is  the 
recording  of  the  discharge  diagnosis  on  the  form.  Although  there  is  reason  to 
believe  that  the  length  of  stay  and  information  on  the  patient's  status  is  shown 
with  a  high  degree  of  accuracy,  the  business  office  does  not  immediately  have  the 
final  discharge  diagnosis  contained  in  the  patient's  medical  record.  In  an  effort  to 
complete  the  bill  quickly,  the  admitting  diagnosis  may  be  recorded  instead  of  the 
discharge  diagnosis. 

The  personnel  and  business  office  may  also  not  have  any  great  skill  for 
medical  terminology  or  good  judgment  concerning  the  relationships  between 
diagnosis  and  surgical  procedures.  The  Social  Security  Administration  is  unaware 
of  the  number  of  hospitals  that  are  not  using  discharge  information  to  complete 
form  SSA-1453. 

Even  when  the  diagnostic  data  on  the  billing  form  have  come  from  the 
medical  record,  there  is  still  a  serious  problem  of  interpretation.  The  instruction 
manual  accompanying  the  forms  emphasizes  that  the  discharge  diagnosis  should 
reflect  information  of  the  patient's  medical  record  relating  to  all  conditions 
causing  the  current  hospitalization,  but  when  the  form  alone  is  in  view,  it  is 
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possible  to  place  other  interpretations  on  the  form's  request  for  primary  discharge 
or  current  diagnosis.  The  problem  can  be  corrected,  in  part,  by  a  more  clearly 
stated  form.  If  the  same  clarity  existed  in  the  face  sheet  itself  from  which  the 
diagnostic  data  is  copied,  and,  in  addition,  if  there  was  a  uniform  face  sheet  in  all 
hospitals,  a  second  step  would  have  been  taken  to  improve  the  reporting  of 
discharge  diagnosis  and  procedures.  Agreement  with  the  medical  profession  on 
definitions  of  face  sheet  items  and  precise  terminology  could  greatly  increase  the 
usefulness  of  consistent  forms. 

The  primary  purpose  of  the  form  SSA-1453  arose  out  of  Social  Security's 
legal  obligation  to  pay  for  covered  services  provided  to  Medicare  beneficiaries. 
The  form's  first  use  is  to  determine  "coverage"  and  the  amounts  to  be  reimbursed 
to  the  hospital.  As  an  important  byproduct,  the  information  tabulated  from  these 
forms  is  also  used  in  implementing  the  system  of  review  of  hospital  services  for 
medical  necessity. 

12.  The  Hospital  Medical  Records  Institute  (HMRI)  of  Ontario,  Canada  (214) 

Medical  care  in  Canada  is  strongly  influenced  by  the  legislation  governing 
health  services  which  provides  for  substantial  control  of  hospitals  by  the 
provincial  governments.  There  were  factors  which  were  considered  sufficient  to 
warrant  the  development  of  a  Canadian  system  for  hospital  utilization  studies  and 
the  evaluation  of  medical  care  that  led  to  the  planning  of  the  Hospital  Medical 
Records  Institute  in  the  Province  of  Ontario.  HMRI  services  approximately  77 
short-term  general  hospitals  in  five  provinces  of  Canada  with  a  total  of 
approximately  600,000  annual  discharges. 

HMRI  was  organized  in  1963  through  the  efforts  of  the  Ontario  Medical 
Association,  the  Ontario  Hospital  Association,  and  the  Ontario  Association  of 
Medical  Librarians.  The  Ontario  Hospital  Association  funded  $150,000  for 
starting  capital.  HMRI  was  organized  under  a  memorandum  of  agreement 
providing  an  independent  board  of  directors  comprised  of  five  appointees  from 
the  OMA  and  OHA  who  are  aided  by  two  advisors  from  the  OAMRL.  The 
memorandum  of  agreement  also  provides  that  the  director  of  the  HMRI  be  a 
licensed  Doctor  of  Medicine. 

The  HMRI  is  primarily  concerned  with  the  promotion  of  a  medical  audit 
system.  HMRI  considers  utilization  studies  as  only  a  part  of  a  good  medical  audit 
model.  The  philosophy  of  HMRI  is  that  data  collected  and  displayed  are  not  in 
themselves  sufficient  for  assessment  of  medical  practice.  It  believes  that  data  must 
be  interpreted  by  those  familiar  with  the  complexities  of  medical  practice  and 
the  local  conditions  prevailing  on  the  community  level.  Consequently,  only 
doctors  on  the  staff  of  the  local  hospital  are  considered  competent  to  evaluate  the 
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quality  of  medical  care  within  their  institution  and  it  is  the  purpose  of  HMRl  to 
assist  them.  Enrollment  in  HMRI  is  contingent  on  the  request  by  the  medical  staff 
and  approval  by  the  governing  body  of  the  hospital. 

HMRI  does  not  exist  for  accounting  purposes  and  has  not  entered  into  this 
field  since  hospitals  are  efficiently  surveyed  and  audited  by  professional  hospital 
service  commissions,  such  as  the  Ontario  Hospital  Service  Commission,  which 
allows  each  hospital  a  certain  per  diem  rate  of  its  operating  budget.  Also,  with  the 
existence  of  a  universal  provincial  insurance  plan,  it  is  unnecessary  to  classify  a 
patient  by  payment  categories. 

HMRI  provides  three  major  types  of  services  to  assist  physicians  in 
developing  and  operating  a  program  of  study  and  control  of  the  quality  of 
medical  care  in  their  hospitals.  These  services  consist  of: 

•  A  variety  of  medical  data  which  is  abstracted  from  patients'  records  is 
turned  over  to  physicians  in  various  organized  reports.  Their  purpose  is 
to  allow  the  assessment  of  patients  care  on  their  own  merit,  in  relation 
to  each  other,  or  to  the  overall  aspects  of  hospital  process.  HMRI  does 
not  feel  justified  in  exchanging  data  among  its  member  hospitals.  If 
comparative  statistics  are  needed,  they  can  be  obtained  from  the 
Hospital  Commission  or  by  a  direct  exchange  of  information  between 
interested  hospitals. 

•  Indices  extensively  cross-referenced  by  disease  and  procedure  are 
provided  on  a  monthly  and  annual  basis.  There  are  other  reports  which 
include  listings  by  physician,  by  medical  record  member,  by  resident 
service,  and  by  physician;  death  listings  by  diagnosis;  service  analyses 
and  hospital  summaries.  These  reports  facilitate  quick  review  and 
appropriate  selection  of  interesting  and  significant  cases  or  events.  The 
indices  also  assist  the  medical  record  librarian  on  the  retrieval  and 
assembling  of  data  for  use  by  physicians. 

•  Analyses  of  each  hospital  service  or  department  and  a  summary  of 
selected  hospital  patient  activities  is  provided  on  a  monthly  and  annual 
basis  for  individual  study  and  for  collective  study  by  those  with 
administrative  responsibilities,  e.g.,  medical  committees,  heads  of 
service,  chiefs  of  staff,  administrators,  and  medical  records  librarians. 

HMRI  also  provides  facilities  for  special  studies  either  with  the  standard  case 
abstract  or  by  design  of  special  abstracts  with  relevant  construction.  The  institute 
provides  consultation  to  doctors  in  developing  these  kinds  of  studies.  The  case 
abstract  is  designed  in  such  a  way  that  data  may  be  introduced  relating  to  any 
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branch  of  a  hospital  staff  should  that  branch  become  interested  in  developing  a 
study.  Although  HMRI  recommends  that  the  coding  of  diseases  and  operations 
follow  the  ICDA,  it  permits  the  use  of  other  coding  systems  that  are  recognized 
and  approved  by  the  physicians  involved.  These  include  the  Systematized 
Nomenclature  of  Pathology  (SNOP)  and  the  American  College  of  Radiology 
Index  of  Radiological  Diagnoses.  Even  though  standardization  of  indexing  of 
records  is  desirable,  it  is  encouraged.  There  are  some  hospitals  in  which  specialized 
code  systems  have  been  developed  to  meet  special  needs.  Therefore,  the  services 
of  a  data  processing  programmer  are  not  denied  the  physicians  in  the  hospital. 

The  following  is  a  summary  of  HMRI  policies: 

•  Since  hospitals  differ  in  the  needs  for  data  both  in  respect  to  type  and 
extent,  HMRI  does  not  compel  hospitals  to  abstract  in  one  or  the  same 
way.  The  HMRI  case  abstract  is  open-ended  as  many  feel  it  possible 
that  multiple  abstracts  may  be  submitted  if  required  to  report  a  case 
completely. 

•  Hospitals  make  the  best  use  of  data  that  are  indexed  in  accordance  with 
their  needs.  Whenever  possible,  though,  data  are  incorporated  into  an 
index  already  available  in  order  to  simplify  the  work  of  HMRI  and 
reduce  the  cost  to  the  consumer. 

•  All  data  for  each  case  appear  in  every  report  to  which  they  are 
pertinent,  regardless  of  the  number  of  Hnes  of  print  required.  There  are 
no  partial  printouts  in  the  report. 

•  Reports  depict  the  involvement  of  each  service  when  a  patient  is 
hospitalized  in  more  than  one.  Coding  of  service  transfers  are 
performed  where  the  hospital  wishes  to  have  pertinent  data  for  each 
service  in  order  to  present  the  true  picture  of  its  work  load. 

•  Hospitals  are  encouraged  to  be  selective  about  detailed  data  on 
investigation  and  management  of  patient  care,  although  any  informa- 
tion will  be  coded  if  desired. 

•  HMRI  does  not  believe  that  the  comparative  experience  of  other 
communities  is  necessarily  germane  to  the  assessment  of  clinical 
judgment.  They  believe  that  the  hospital  comparisons  are  only  useful 
when  all  factors  affecting  and  influencing  the  practice  of  medicine  in 
communities  are  understood.  Comparative  studies  are  viewed  as  being 
potentially  misleading. 
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13.  Hospital  Inpatient  Enquiry  (278) 


The  statistical  record  of  the  hospital  service  in  England  and  Wales  began  in 
1949  as  HIPE.  Its  purpose  was  to  be  a  guide  to  morbidity  occurrence  in  the 
community,  and  for  use  for  central  and  local  planning  purposes  in  terms  of  the 
characteristics  of  patients  and  their  diseases. 

HIPE  has  been  through  three  stages: 

•  Volunteer  hospitals  supplied  summaries  on  100  percent  of  all  patients 
discharged  (1949  and  1951). 

•  Attempts  were  made  to  collect  summaries  from  every  10th  patient 
discharged  from  all  national  health  service  hospitals  excluding  mental 
health  hospitals,  full  fee  paid  paying  patients,  and  some  staff  patients 
(1952-64). 

•  An  increasing  number  of  hospital  regions  (fifteen  statutory  bodies 
responsible  for  running  the  hospitals)  are  collecting  summaries  of  all 
patients  discharged  and  supplying  the  HIPE  quota  from  their  own  file 
(1965-present). 

Although  the  collection  or  processing  of  records  is  on  a  continual  system, 
the  results  emerge  as  yearly  batches.  The  time  lag  between  the  end  of  the  year  of 
discharge  and  the  first  firm  tabulation  is  less  than  twelve  months,  while  the  time 
until  publication  is  extended  to  as  much  as  two  and  one-half  years.  The  system  is 
limited  by  the  slowest  hospital  in  the  country,  which  is  the  weakest  link  in  the 
series  of  sequential  events.  Regions  which  process  their  own  data  and  assist  in  the 
Hospital  Activities  and  Analysis  (HAA)  do  produce  quicker  returns. 

The  records  received  by  HIPE  contain  either  the  name  or  the  address  of  the 
patient  but  they  do  not  contain  the  name  of  the  physician  in  charge.  In  the  early 
stage  of  HIPE,  an  attempt  was  made  to  link  the  records  of  the  same  patients  by 
means  of  name,  or  initials,  which  was  done  at  the  regional  level  and  also 
experimentally  at  HIPE.  In  general,  the  numbers  provided  by  HIPE  are  periods  of 
hospitalization  (not  numbers  of  patients)  and  are  inflated  by  one  patient  entering 
the  hospital  more  than  once  or  being  counted  more  than  once  by  transferring 
hospitals.  HIPE  currently  publishes  about  20  standard  tables  annually  showing 
cross-tabulations  by  age,  records,  patient  days,  diagnosis,  deaths,  accidents, 
hospitalization  patterns  and  children,  and  other  parameters.  In  addition,  several 
reference  tables  are  produced.  One  of  the  most  useful  of  these  has  proved  to  be 
the  analysis  of  each  four-digit  ICD  category  into  13  age  groups  for  each  sex.  Some 
inquiries  need  special  computer  runs,  others  need  ad  hoc  programs. 
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A  simple  method  of  retrieving  information  about  the  small  groups  is  a 
line-by-line  printout  of  the  coded  record.  This  enables  the  original  source 
document  to  be  identified  and  reviewed  either  for  checking  or  for  further 
information.  It  has  proved  particularly  useful  in  revealing  drugs  and  poisons. 

The  use  of  a  1 0  percent  sample  facilitated  initiation  of  HIPE  by  reducing  the 
work  load  in  a  local  hospital  and  in  reducing  the  running  time  needed  to  process 
punch  cards  with  mechanical  equipment.  The  processing  of  summaries  locally  by 
regions  is  considered  to  be  beneficial  because  of  closer  control  of  the  quality  of 
the  entry  data.  Greater  administrative  control  at  the  local  level  will  work  towards 
rapidity  in  processing  the  statistics.  Processing  at  the  hospital  level  is  confined 
mainly  to  the  larger  hospitals  and  to  the  teaching  hospitals  and  enables  catering  to 
the  personal  desires  of  the  hospital  staff. 

Since  the  records  are  anonymous,  it  is  not  possible  to  identify  repeated 
admissions  of  the  same  patients;  i.e.,  count  is  of  hospitahzations,  not  patients 
treated.  Also,  the  records  cannot  be  checked  against  deaths  or  other  sources  of 
information. 

HIPE  is  at  a  disadvantage  because  of  the  provision  of  free  hospital  treatment 
in  Britain,  which  removes  one  important  incentive  to  processing  patients'  data 
rapidly  before  discharge  from  the  hospital.  Most  hospitals  find  that  a  substantial 
portion  of  records  are  not  returned  to  the  medical  records  department  until  six 
weeks  after  discharge.  The  absence  of  this  financial  incentive  also  removes  a 
simple  method  of  measuring  efficiency  in  hospital  administration  by  the 
"throughput  of  patients."  The  best  financial  policy  for  hospitals  may  not  be  the 
best  policy  for  the  patient,  nor  may  it  be  the  best  policy  for  a  service  which  is 
responsible  for  the  patient  after  discharge  from  the  hospital. 

Some  investigators  are  incUned  to  accept  HIPE  data  as  accounting  for  all 
hospital  services  in  the  country,  although  more  than  10  percent  of  the  patients  are 
in  private  units  outside  of  the  national  health  service.  Fragmentary  and  indirect 
information  about  the  10  percent  can  be  obtained  but  more  information  possibly 
through  other  channels  is  needed. 

The  development  of  HIPE  entailed  the  formulation  of  special  classification 
of  service  needs.  For  example,  an  operation  code  was  developed  in  1951  and  a 
first  version  was  pubhshed  in  1956.  Based  on  experience,  a  revision  was  concluded 
in  1969.  A  code  for  geographical  administrative  areas  was  also  needed  to  classify 
the  place  of  residence  of  patients  since  the  existing  codes  took  no  account  of 
hospital  regions.  The  diagnostic  code  (ICD)  was  found  to  be  inadequate  to  code 
the  detail  required  in  some  parts,  and  special  subdivisions  were  subsequently 
introduced. 


275 


Arthur  D  Little  Inc. 


Inclusion  of  more  clinical,  laboratory,  therapeutic  data  and  summaries  will 
require  the  production  of  classifications  to  more  adequately  cover  symptoms, 
including  complaints  and  physical  signs,  results  of  clinical  and  laboratory  tests, 
and  details  of  incentive  and  other  care. 

The  comparison  of  length  of  stay  has  been  considered  important  but  no 
solution  has  been  found.  Three  major  suggestions  have  been: 

•  Arithmetic  mean 

•  Median 

•  Geometrical  mean 

In  terms  of  the  use  of  HIPE  data,  the  interest  of  hospital  administrators  has 
focused  on  the  following  topics: 

•  Duration  of  stay  to  investigate  the  causes  of  regional  or  other 
differences  or  to  plan  for  extensions  or  changes. 

•  Differences  in  admission  rates  per  head  of  population. 

•  Catchment  areas  of  hospitals  and  hospital  groups  to  determine  where 
deficiencies  of  service  might  lie. 

•  Department  differences  to  aid  in  the  planning  of  buildings  and  staff 
training. 

•  Frequency  of  readmission  or  the  occurrence  of  death  after  discharge. 

•  The  influence  of  personal  and  environmental  factors,  not  only  age  and 
sex,  but  marital  status,  occupation  and  social  class,  housing  conditions, 
and  household  circumstances. 

•  The  reasons  for  changes  in  the  admission  rates,  whether  due  to  real 
changes  in  disease  incidence,  changes  in  medical  views  and  practice,  or 
changes  in  social  structure. 

•  The  presence  of  environmental  hazards,  especially  poisoning  by  drugs 
and  external  pollutants. 
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14.  Scottish  Hospital  Inpatient  Statistics  (112) 

In  Scotland,  the  collection  of  statistical  data  on  patients  discharged  from 
national  health  service  hospitals  was  started  in  1961  when  a  statistical  abstract 
was  completed  for  every  inpatient  with  the  exception  of  those  discharged  from 
obstetric  wards  and  mental  hospitals.  These  statistical  abstracts  were  anonymous 
at  that  time  except  that  it  enabled  the  individual  patient  to  be  identified  at  the 
hospital  by  means  of  a  case  reference  number.  This  form  was  amended  in  1967 
and  consideration  is  being  given  to  further  amendment.  In  1963,  the  service  was 
extended  by  including  data  on  patients  in  mental  hospitals,  and  in  1969, 
obstetrical  hospitals  were  also  included.  Although  the  basic  material  on  the  forms 
is  identical,  no  attempt  has  been  made  at  producing  a  single  set  of  statistics. 

The  initial  purpose  of  these  statistics  was  to  provide  central  and  regional 
administrators  with  facts  concerning  the  use  made  of  the  most  costly  part 
(hospitalization)  of  the  national  health  service.  With  data  available  on  the  basis  of 
summaries  of  individual  patient  records,  a  large  amount  of  flexibility  of  analysis 
was  available  which  could  not  be  obtained  from  tabular  statistical  summaries  of 
activities  of  hospitals.  These  data  enable  observation  to  be  maintained  on  the 
trends  of  disease  among  hospital  patients  and  on  the  social  and  demographic 
characteristics  of  these  patients.  These  data  are  also  of  assistance  in  planning  and 
administration  of  services.  Since  it  has  been  a  general  policy  to  provide  feedback 
to  individual  hospitals,  sampling  has  never  been  considered  in  collection  and 
initial  processing. 

The  second  purpose  of  these  statistics  was  to  provide  epidemiologic  data, 
using  the  term  in  its  broadest  sense,  since  hospital  data,  even  considering  their 
drawbacks,  remain  the  most  important  source  of  data  on  morbidity  in  the 
community.  The  difficulties  of  interpreting  are  tremendous  since  current  statistics 
relate  to  episodes  of  inpatient  treatment,  rather  than  to  patient's  discharge,  and 
because  of  the  high  degree  of  selection  operating  on  the  admission  of  patients  to 
the  hospital. 

During  the  period  of  data  collection,  their  potential  value  to  physicians  has 
been  greatly  reahzed  and  it  is  felt  that  the  most  important  reason  for  their 
collection  is  to  provide  physicians  with  statistical  data  on  the  management  of 
their  patients  and  to  form  a  starting  point  for  clinical,  epidemiologic  and  medical 
care  studies.  Since  they  are  related  to  all  patients  and  not  just  a  sample  and 
because  identifying  data  can  be  provided,  a  listing  of  all  inpatients  discharged 
from  a  hospital  is  routinely  made  available  for  use  at  the  hospital  and,  subject  to 
restrictions  on  confidentiality,  a  similar  listing  held  centrally  can  be  used  to 
provide  research  workers  with  what  is  in  effect  a  national  diagnostic  or  disease 
index. 
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The  abstract  form  for  the  general  hospital  inpatients  allows  identification  of 
the  individual  patient  by  means  of  surname,  initials,  data  of  birth,  marital  status, 
and  case  reference  number,  and  the  individual  consultant  or  general  practitioner 
in  charge  of  the  case  in  the  hospital  is  also  identified  by  means  of  code  or  number. 
The  form  was  designed  to  serve  a  dual  purpose  as  both  a  statistical  abstract  and 
clinical  summary.  It  is  a  two-part  form  with  the  top  copy  being  sent  to  the 
Scottish  Home  and  Health  Department  and  the  bottom  one  being  retained  in  the 
patient's  clinical  notes  with  a  clinical  summary  attached. 

The  forms  themselves  are  usually  completed  by  a  medical  records  clerk, 
although  the  responsibility  for  the  accuracy  of  the  abstraction  of  medical 
information  rests  on  the  consultant  in  charge  of  the  case  and  it  is  known  that  this 
is  not  always  strictly  observed.  Until  recently,  there  has  been  little  local  use  made 
of  the  data  and  the  completion  of  the  form  is  delegated  to  a  junior  clerk,  often 
with  little  insight  into,  or  knowledge  of,  the  medical  problems  involved.  This 
results  in  the  abstraction  of  the  wrong  term  or  abstraction  of  an  incorrect  order. 
Coding,  with  the  exception  of  occupation,  is  done  at  the  hospital.  The  completed 
forms,  which  amount  to  approximately  five  hundred  thousand  per  year,  are 
submitted  to  the  Scottish  Home  and  Health  Department  usually  within  one 
month  of  the  discharge  of  the  patient.  Forms  are  also  completed  when  a  patient  is 
transferred  to  the  care  of  another  physician. 

There  are  basically  three  types  of  routine  tabulations  that  are  produced 
annually  and  two  types  that  retain  listings.  In  addition,  ad  hoc  tabulations  and 
listings  can  be  produced  at  the  request  of  hospitals  or  bona  fide  researchers.  The 
reports  are  described  below. 

Routine  Tabulations 

•  Published  Tables 

These  are  prepared  annually.  Also,  the  tables  have  diagnosis  as  one  of 
the  principal  factors  and  these  data  are  shown  variously  by  duration  of 
stay,  waiting  time,  etc.  Time  trends,  regional  and  urban/rural  variations, 
and  specialty  of  treatment  are  among  the  subjects  analyzed.  The  tables, 
in  essence,  provide  a  statistical  description  of  inpatients  in  Scotland. 

•  Regional  Hospital  Tables 

Tabulations  which  are  not  published  are  sent  to  every  hospital  in 
Scotland  giving  details  of  the  inpatient  work  of  that  hospital  according 
to  the  many  factors  in  the  published  tables,  but  putting  particular 
emphasis  on  the  diagnostic  and  specialty  aspects.  A  table  is  also 
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provided  showing  the  service  area  for  each  hospital  as  a  whole  and  for 
each  department.  Regional  hospital  boards  also  receive  copies  of  these 
tables,  together  with  regional  summaries.  The  tables  provide  a  basis  for 
comparing  the  detailed  work  of  an  individual  hospital  with  a  national  or 
regional  norm. 

•  Scottish  Consultant  Activity  Review  Statistics  (SCARS) 

Starting  with  1967  data,  tables  were  sent  directly  to  each  physician 
responsible  in  the  inpatient  care  of  patients  describing  his  case  load  in 
the  area  of  review.  These  tables  are  described  below. 

Routine  Listings 

•  Diagnostic  or  Disease  and  Operations  Index 

An  index  is  sent  to  each  hospital  or  board  of  management  listing  the 
patient  treated  in  the  hospital  in  the  order  of  diagnosis  of  the  ICD,  and 
an  operation  index  is  provided  in  the  order  of  the  General  Register 
Office  Code  of  Surgical  Operations.  Space  is  provided  in  the  summary 
form  for  the  recording  of  up  to  three  diagnoses  and  two  operations  per 
admission  and  the  case  will  appear  in  the  index  under  each  diagnosis  or 
operation  recorded.  These  indexes  are  usually  held  in  the  medical 
records  department  of  each  hospital. 

The  hospital  diagnostic  index  serves  two  purposes.  The  first  is  to  enable  easy 
identification  of  cases  and  to  facilitate  access  to  appropriate  clinical  notes  which 
might  be  needed  for  research  purposes  or  perhaps  for  examination  as  part  of 
patient  care  evaluation  procedures.  The  second  is  for  the  index  to  form  the  basis 
of  simple  tabulations  required  for  either  clinical  or  administrative  use. 

The  second  form  of  the  diagnostic  index  is  the  national  one  which  is  held  in 
the  research  and  intelligence  unit  of  the  Scottish  Home  and  Health  Department. 
Apart  from  the  ease  with  which  many  of  the  simpler  statistical  questions  can  be 
answered  from  each  listing,  this  provides  research  workers  with  access  to  either  a 
national  sample  or  a  complete  hst  of  cases  treated  in  the  hospital  with  a  certain 
condition.  Patient  names  are  not  disclosed  to  research  workers.  The  Scottish 
Hospital  Inpatient  Statistics  do  not  differ  basically  from  any  other  health  data 
systems  in  the  field.  However,  there  are  two  aspects  in  which  developments  in 
progress  may  be  rather  unusual.  The  data  that  has  been  sent  to  hospitals  are 
relatively  bulky  and  require  considerable  effort  on  behalf  of  those  interested  to 
make  the  desired  extractions  on  any  particular  topic.  Although  they  may  be  of 
considerable  value  to  medical  administrators,  it  is  unlikely  that  anyone  but 
physicians  with  marked  epidemiologic  interests  would  have  any  particular  use  for 
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them,  and  then  only  rarely.  It  was  felt  that  the  data  in  this  form,  which  is  similar 
to  those  issued  by  CPHA  and  others,  lose  much  of  their  impact  because  of  this. 

Consequently,  there  has  been  an  attempt  to  produce  summary  data  so  that 
each  physician  is  presented  with  one,  or  at  the  most  two,  sheets  of  paper  in  which 
some  detail  of  his  own  work  is  shown.  Starting  with  the  data  for  1967,  tables  have 
been  sent  directly  from  the  department  to  those  physicians  responsible  for  the 
care  of  inpatients,  describing  his  case  load  for  the  year  under  review.  Together 
with  these  tables,  comparative  regional  and  national  tables  for  the  same  specialty 
and  an  accompanying  letter,  and  note  of  explanation  are  also  sent. 

The  material  sent  to  each  physician  relates  only  to  his  own  work  and  to 
regional  and  national  averages.  It  is  hoped  that  physicians  finding  information  of 
sufficient  interest  will  compare  their  experiences  with  that  of  their  colleagues. 
Similarities  and  differences  revealed  might  then  result  in  the  initiation  of  further 
investigation  to  provide  a  basis  on  which  patient  care  evaluation  techniques  could 
be  developed. 

The  statistical  data  abstract  at  the  present  is  extremely  limited  and 
experiments  sponsored  by  the  Scottish  Home  and  Health  Department  are  aimed 
at  the  possiblity  of  extensions  through  a  particular  specialty.  Another  possible 
extension,  presently  under  investigation,  is  the  abihty  to  provide  a  set  of  spare 
boxes  on  the  abstract  form  which  physicians  will  be  encouraged  to  use  as  they 
wish  with  the  department  undertaking  simple  analyses  on  requests.  Inpatient  data 
only  cover  a  part,  although  an  important  part,  of  hospital  work.  With  the 
increasing  tendency  towards  outpatient  care  and  domiciliary  treatment,  there  is  a 
need  for  statistics  on  outpatient  care.  The  problem  here  is  one  of  greatly  increased 
numbers  that  have  to  be  handled.  The  national  collection  of  outpatient  statistics 
probably  will  wait  until  the  necessary  statistics  can  be  captured  as  a  by-product  of 
routine  procedures.  However,  a  small  part  of  the  study  has  recently  been  done 
using  an  amended  version  of  the  abstract  form.  In  addition,  a  special  abstract 
form  is  used  for  patients  in  mental  hospitals  and  for  patients  discharged  from 
psychiatric  wards  in  general  hospitals.  Because  of  the  long  duration  of  stay  of 
many  patients  in  these  institutions.,  it  has  been  thought  necessary  to  have 
statistics  available  upon  admission,  discharges,  and  residence.  In  addition,  statistics 
are  also  being  collected  for  obstetrical  patients. 
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15.  The  Hospital  Discharge  Abstract  System  in  British  Columbia  (256) 

On  January  1,  1969,  the  British  Columbia  Hospital  Insurance  Service  began 
its  21st  year  of  operation.  The  province's  program  has  four  main  objectives: 

•  To  protect  residents  from  the  problems  of  the  financial  burdens 
associated  with  hospitalization. 

•  To  provide  the  hospitals  of  the  province  with  a  regular  source  of 
income. 

•  To  assist  hospitals  in  developing  and  maintaining  high  standards  of 
patient  care. 

•  To  assist  communities  in  providing  adequate  hospital  facilities. 

During  recent  years,  the  service  has  developed  from  a  bill-paying  organiza- 
tion to  the  agency  responsible  for  providing  hospital  care  and  has  given  more 
emphasis  to  the  latter  two  objectives.  It  is  towards  this  end  that  the  province  has 
developed  its  system  of  data  collection.  Because  of  its  usefulness  in  hospital 
planning,  in  addition  to  collecting  hospital  data,  the  British  Columbia  Hospital 
Insurance  Service  is  also  the  largest  user. 

The  basic  form  used  by  the  British  Columbia  Hospital  Insurance  Service  for 
data  abstraction  is  called  the  admission/separation  record.  This  form,  suppUed  to 
all  hospitals,  is  completed  for  each  patient  admitted  to  the  hospital.  It  is  a 
multi-purpose  form  used  by  a  number  of  divisions  within  the  service,  and  consists 
of  one  page.  There  are,  however,  conflicts  over  space.  Space  allocations  are 
guarded  when  requests  for  additional  information  are  made  and  this  is  the  limiting 
factor  in  the  abstraction  of  discharge  data. 

Most  of  the  information  on  the  admission/separation  record  is  entered 
at  the  hospital;  however,  medical  and  residence  coding  is  done  by  the  hospital 
insurance  service.  As  is  the  case  in  most  provinces  in  Canada,  diagnostic 
information  is  coded  according  to  the  International  Classification  of  Diseases, 
adapted.  The  information  is  abstracted  from  the  hospital's  medical  records 
provided  by  the  hospital,  and  coded  by  the  medical  coders  from  the  Hospital 
Insurance  Service.  This  creates  an  environment  for  uniformity  in  coding.  Provision 
is  made  for  coding  a  primary  and  secondary  diagnosis  and  a  primary  and 
secondary  operation  as  well  as  external  causes  of  injury  for  accident  cases.  There 
is  presently  in  Canada  some  conflict  of  opinion  as  to  what  should  constitute  a 
primary  and  secondary  diagnosis.  A  number  of  provinces  have  adopted  the 
utilization  view,  such  that  the  primary  diagnosis  is  the  diagnosis  that  is  most 
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important  in  terms  of  utilization  of  hospital  services.  The  province  of  British 
Columbia  adopted  the  view  that  the  primary  diagnosis  should  be  the  cause  of 
admission  to  the  hospital.  Listed  below  are  the  items  which  are  transferred  from 
the  admission/separation  record  to  magnetic  tape  of  the  hospital  insurance 
service. 

•  Hospital  identification 

•  Patient  identification 

•  Residence 

•  Sex 

•  Age 

•  Date  of  separation  (discharge) 

•  Date  of  admission 

•  Patient  days 

•  Type  of  separation 

•  Primary  diagnosis 

•  Secondary  diagnosis 

•  Operations 

•  Accidents 

•  Responsibility  for  payment  i 

Application  of  the  data  falls  generally  into  one  of  three  categories: 
morbidity,  hospital  planning,  and  special  studies.  The  requirements  of  the  first 
two,  and  to  some  degree  the  third,  are  fairly  predictable  within  the  range  of 
available  data  so  that  certain  tabulations  are  prepared  routinely  to  minimize  the 
number  of  special  listings. 

Hospital  morbidity  data  is  collected  by  each  province  in  Canada  but  reported 
on  a  standard  format  for  the  purpose  of  providing  national  morbidity  statistics. 
Consequently,  from  an  abridged  hst  of  ICDA  Codes,  the  current  Canada  hst  of 
188  diagnostic  categories  has  been  developed.  This  list  which  was  used  for  the 
first  time  in  1969  is  a  revision  of  the  former  hst  of  98  diagnostic  categories.  The 
standard  morbidity  tables  used  by  the  provinces  are: 

•  Summary  of  hospitalization  according  to  responsibility  for  payment  as 
recorded  by  the  province;  discharges  during  the  year  and  patient  days 
since  admission  of  these  discharges. 

•  Hospitalization  by  sex  and  age  for  all  persons  hospitalized  in  the 
province. 

•  Discharges  and  patient  days  and  corresponding  rates,  by  size  of 
community  of  residents,  for  all  persons  hospitalized  in  the  province. 
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•  Discharges  and  patient  days  by  length  of  stay,  by  sex  and  age,  for  all 
persons  hospitalized  in  the  province. 

•  Discharges  and  patient  days  by  primary  diagnosis,  race,  sex,  and  age,  for 
all  persons  hospitalized  in  the  province. 

•  Number  of  hospital  discharges  classified  by  the  unabridged  diagnostic 
groupings  —  with  and  without  surgery  —  and  the  number  of  discharges 
with  selected  related  special  procedures  for  all  persons  hospitalized  in 
the  province. 

•  Selected  operations  reported  by  related  diagnosis  by  hospitals  for  all 
persons  hospitalized  in  the  province;  number  and  discharge  and  rates 
per  100,000  population,  number  of  related  operations,  and  average  stay 
of  operations. 

•  Discharges,  days  of  care,  and  average  length  of  stay  for  the  two-digit 
categories  of  operations,  and  treatment  for  all  persons  hospitalized  in 
the  province. 

Under  a  program  of  comprehensive  hospital  care  the  British  Columbia 
Hospital  Insurance  Service  has  been  able  to  analyze  the  complete  pattern  of 
hospital  care  within  the  province.  Data  collected  are  primarily  geared  to  hospital 
utilization  of  the  provincial  level.  At  the  present  time,  it  does  not  attempt  to 
record  or  tabulate  medical  data  required  by  medical  utilization  committees  at  the 
local  hospital  levels.  However,  there  is  still  sufficient  data  to  point  out  areas  that 
may  need  to  be  investigated. 

16.  The  Hospital  Discharge  Abstract  Systenn  of  the  Saskatchewan  Hospital 
Services  Plan  (207) 

The  Saskatchewan  Hospital  Services  Plan  began  in  1947,  replacing  a 
patchwork  of  financial  aid  arrangements  between  the  provincial  government  and 
the  various  hospitals  as  well  as  sundry  municipal  ventures  aimed  at  paying  for 
hospital  service  provided  to  residents.  When  the  Saskatchewan  Hospitalization  Act 
was  passed  in  1 946,  there  already  existed  a  Health  Services  Planning  Commission, 
and  this  body  was  given  responsibility  for  administering  the  new  act.  In  order  to 
do  this,  a  division  was  created,  namely,  the  Saskatchewan  Hospital  Services  Plan. 
SHSP  had  the  following  responsibilities: 

•  Registration  of  residents 

•  Collection  of  prescribed  personal  tax 
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Handling  claims 


•  Payment  to  hospitals 

The  interfacing  of  these  four  elements  largely  determined  the  data  which 
needed  to  be  collected.  Modifications  have  occurred  since,  but  the  format  of  the 
present  admission/separation  form  is  derived  largely  from  these  early  require- 
ments of  SHSP. 

The  emphasis  was  on  the  insurance  aspect,  verifying  that  the  claim  was 
legitimate  on  behalf  of  the  fully  paid  beneficiary.  Demographic  variables,  such  as 
age,  sex,  place  of  birth,  and  marital  status,  and  discharge  diagnosis  were  recorded, 
analyzed  and  reported,  but  no  responsibility  lay  with  SHSP  to  become  involved 
with  the  problem  of  quality  of  care.  This  responsibility  lay  with  another 
governmental  agency,  namely,  the  Division  of  Hospital  Administration  and 
Standards.  With  the  advent  of  universal  and  medical  care  insurance  in  1962, 
another  dimension  was  added  to  the  provision  of  health  care  and  a  re-appraisal  of 
the  administrative  channels,  SHSP,  and  the  Division  of  Hospital  Administrative 
Standards  were  combined  in  1964  into  a  new  hospital  branch.  The  major 
responsibilities  of  SHSP  are: 

•  Registration  of  residents  and  to  collect  the  joint  hospitalization  tax  and 
medical  care  premium. 

•  To  finance  the  operations  of  approved  hospitals  and  to  provide 
planning  and  financial  assistance  to  hospital  construction. 

•  To  insure  the  maintenance  of  minimum  standards  of  safety  for 
inpatient  care. 

•  To  authorize  the  expansion,  improvement  and  addition  of  programs  in 
the  hospitals. 

The  admission/separation  record  is  submitted  by  the  individual  hospitals  on 
the  discharge  or  death  of  each  patient,  whether  covered  by  SHSP  or  not.  For 
SHSP  cases,  the  eligibility  of  the  patient  is  checked  manually  since  it  was 
determined  to  be  more  economical  than  computer  checking. 

All  general  hospitals  in  Saskatchewan  are  paid  semi-monthly  on  the  basis  of  a 
predetermined  budget.  Since  there  is  no  immediate  payment  for  patient  days,  no 
purpose  is  served  in  issuing  the  hospitals  with  printouts  of  the  discharges. 
Therefore,  there  is  no  continuing  reporting  to  the  hospitals  on  these.  The 
discharge  reports  are  used  by  program  officers  on  SHSP  who  determine  whether  a 
hospital  is  running  above  or  below  the  utilization  level  which  has  been  predicted 
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in  setting  its  budget.  Therefore,  adjustments  of  rates  may  be  made  throughout  the 
fiscal  year.  Annual  reporting  by  SHSP  is  required  by  statute,  and  the  data 
contained  in  the  admission/separation  record  together  with  the  financial  data 
comprise  the  bulk  of  such  reporting. 

The  advantage  of  the  system  is  that  a  total  experience  is  obtainable  for  a 
clearly  defined  population  of  approximately  one  million  people.  The  major 
disadvantage  is  that  the  clinical  variables  are  gross  in  the  extreme  —  discharge 
diagnosis  and  type  of  operation  and/or  accident,  if  applicable.  Therefore,  the 
medical  audit  approach  is  capable  of  only  limited  application  using  the  present 
admission/separation  form.  It  is  capable,  however,  of  yielding  such  indices  as  the 
average  days  of  stay  by  type  of  case  and  by  age  of  patient  for  each  hospital,  and 
each  admitting  doctor.  Such  indices  are  useful  in  detecting  practices  which  are 
grossly  out  of  line  and  any  finer  clinical  detail  would  require  modification  of  the 
discharge  form  as  presently  constituted. 

The  government  has  an  obligation  to  insure  that  a  satisfactory  level  of 
quality  is  provided  SHSP  beneficiaries.  One  of  the  areas  in  which  a  modified 
control  can  be  exerted  hes  in  insuring  that  operative  procedures  are  not  carried 
out  in  institutions  which  do  not  have  the  facilities  or  supporting  staff  to 
adequately  perform  such  procedures.  This  problem  is  particularly  relevant  in 
Saskatchewan  because  of  its  heritage  of  a  multitude  of  very  small  hospitals.  The 
discharge  record  serves  as  a  basis  for  such  control. 

Presently  in  progress  is  a  project  aimed  at  linking  the  records  of  separate 
health  programs  which  have  been  developed  more  or  less  autonomously  over  the 
years.  Paralleling  the  hospital  are  two  other  major  health  programs: 

•  Provincial  medical  care  insurance  plan  which  is  concerned  with  insuring 
of  physician  and  optometrist  services;  and 

•  Provincial  psychiatric  programs  which  provide  services  to  the  province's 
population  on  inpatient  and  outpatient  basis. 

The  point  has  been  reached  where  patient  records  from  these  three  major 
programs  can  be  integrated  and  combined  into  a  patient  history.  It  is  anticipated 
that  other  health  programs  as  well  as  the  vital  statistics  registration  data  can  be 
incorporated  into  this  overall  health  intelligence  system. 

The  success  of  this  particular  project  has  underscored  the  point  that  hospital 
data  are  but  one  component  of  the  total  health  profile  of  the  community: 
refinement  in  the  quality  of  the  former  leads  directly  to  the  clear  definition  of  the 
latter. 
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17.  The  Patient  Data  Study  of  the  American  Hospital  Association  (66) 

AHA's  Patient  Data  Study  was  not  developed  as  an  operating  system  for  the 
collection  and  descriptive  use  of  patient  information.  The  study  was  basically  a 
methodologic  research  project  on  the  collection  and  potential  use  of  patient  data 
for  the  purpose  of  hospital  management.  AHA  faced  three  major  questions 
regarding  the  collection  of  health  information  as  a  tool  for  hospital  management. 
They  were: 

•  What  patient  data  items  are  most  pertinent  to  the  operation  of  an 
institution? 

•  How  do  you  obtain  an  economically  valid  data  on  a  regular  basis? 

•  How  do  you  interrelate  items  of  patient  and  nonpatient  data  and 
translate  them  into  management  indicators? 

In  early  1966,  the  Bureau  of  Research  Services  of  AHA  undertook  a 
methodological  study  to  develop  an  economical  and  effective  system  for 
collecting  valid  data.  The  long-range  objectives  of  the  study  were  to: 

•  Develop  a  continuing  program  for  the  study  of  the  effect  of  patient 
variables  on  the  management  effectiveness  of  hospitals. 

•  Increase  the  effectiveness  of  present  operations  in  future  planning 
through  the  use  of  a  management  tool  developed  with  the  combination 
of  patient  data  and  nonpatient  data. 

•  Development  within  hospitals  and  related  institutions  of  permanent 
relevant  sources  of  data  for  management  research  purposes. 

The  study  was  designed  to  be  carried  out  in  four  phases: 

Phase  1: 

Methodological  development  of  a  system  of  inpatient  data  collection. 
Phase  2: 

Research  exploring  the  use  of  inpatient  data  for  purposes  of  management 
measurements  and  improvements. 
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Phase  3: 


Integration  of  the  patient  aspect  into  the  Hospital  Administrative  Services 
Program  (HAS). 

Phase  4: 

Expansion  of  the  patient  data  program  to  hospital  outpatient  ancillary 
services  and  to  services  of  related  health  care  institutions. 

The  accomplishments  of  Phase  1  are  listed  in  this  section.  Goals  of  Phase  1 
were  to: 

•  Develop  a  system  of  collecting  valid  patient  data  for  research  purposes. 

•  Test  the  system  in  a  selected  group  of  community  hospitals. 

•  Code  and  process  the  data  centrally. 

•  Make  a  preliminary  analysis  of  the  data,  both  alone  and  in  combination 
with  nonpatient  data. 

•  Convene  an  advisory  panel  to  evaluate  findings  of  Phase  1  and  to 
recommend  a  course  of  action  for  Phase  2. 

The  resource  document  for  the  collection  of  patient  data  for  Phase  1  was  a 
three-part  discharge  summary  form.  The  Joint  Commission  of  Accreditation  of 
Hospitals  was  consulted  regarding  the  discharge  summary  form  and  the  form  was 
designed  to  include  the  subject  titles  for  compUance  with  their  five  points,  which 
are: 

•  Why  did  the  patient  enter  the  hospital? 

•  What  were  the  pertinent  laboratory,  X-ray,  and  physical  findings? 

•  What  was  the  medical  and/or  surgical  treatment? 

•  What  was  the  physical  condition  of  the  patient  when  he  left  the 
hospital? 

•  What  instructions  were  given  about  further  care? 
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The  original  copy  was  designed  to  be  used  as  an  integral  part  of  the  hospital 
medical  record.  The  form  includes  a  second  copy  for  the  physician.  A  third  copy 
which  was  modified  for  confidentiality  and  ease  of  coding  was  forwarded  to  the 
AHA  for  processing. 

The  discharge  summary  offers  certain  advantages  to  the  hospital  and  to  the 
physician: 

•  Medical  record  simpUfication 

•  Utilization  review 

•  Continuity  of  care 

Twenty  community  hospitals  that  were  participating  in  the  Hospital 
Administrative  Services  program  participated  in  the  field  testing  of  the  form. 
These  hospitals  ranged  in  size  from  66  to  381  beds,  12  of  which  had  less  than  150 
beds.  They  were  geographically  located  across  the  United  States.  At  the 
conclusion  of  the  test,  8,788  summaries  had  been  received  from  the  hospitals. 
Documents  were  edited  and  coded  centrally  by  a  team  consisting  of  two  medical 
record  librarians  and  two  senior  medical  students.  Seven  major  reports  were 
prepared: 

•  Distribution  of  discharges  by  hospital  by  age. 

•  Distribution  of  discharges  by  hospital  by  days  of  stay. 

•  Distribution  of  discharges  by  hospital  by  history  of  previous  admission. 

•  Distribution  of  discharges  by  hospital  by  principal  diagnosis. 

•  Distribution  of  discharges  by  principal  diagnosis  by  days  of  stay. 

•  Distribution  of  operations  by  hospital  by  type  of  operation. 

•  Distribution  of  discharges  by  hospital  by  course  of  patient. 

A  report  detailing  clinical  information  on  patient  stays  of  over  1 5  days  in 
seven  of  the  hospitals  summarized  data  on  principal  diagnoses  and  operations  and 
a  report  in  graph  form  on  the  distribution  by  age,  operation  and  days  of  stay. 

After  review  by  the  advisory  committee,  the  following  analyses  were 
recommended  to  provide  a  basis  for  isolating  critical  patient  variables  among  the 
hospitals: 
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•  Length  of  stay  patterns  by  age,  sex,  diagnosis,  presence  of  1  to  3 
associated  diagnoses,  and  disposition  of  the  patient. 

•  Special  breakdown  of  stays  under  three  days  and  over  fifteen,  by  age 
and  diagnostic  category. 

•  Length  of  stay  breakdown  for  all  surgical  cases  by  the  number  of  days 
pre-operative  and  post-operative. 

•  Consultation  rates  for  10  well-defined  diagnosis  categories. 

•  Percentage  of  autopsies,  overall  and  by  age  of  patient  and  diagnosis 
category. 

•  Patients  readmitted  by  age  category,  omitting  the  expired  cases. 

•  Coronary  cases  relating  to  the  length  of  stay  and  further  related  to  the 
number  of  coronary  deaths  by  age  of  patient. 

•  Comparison  of  above  length  of  stay  to  non-patient  data  where 
appropriate. 

18.  The  National  Hospital  Discharge  Survey  (114) 

This  survey  is  an  integral  part  of  the  National  Health  Survey  System 
administered  by  the  National  Center  of  Health  Statistics.  Three  elements  of  the 
National  Health  Survey  include  the  Health  Interview  Survey  (HIS),  which  is  a 
continuing,  national  sample  survey  of  the  health  of  the  non-institutional 
population  as  reported  by  household  members;  the  Health  Examinations  Survey 
(HES),  which  is  also  a  continuing,  national  non-institutional  sample  but  for  which 
the  relevant  health  of  the  population  is  measured  and  reported  by  a  team  of 
medical  professionals  and  a  system  of  Health  Resources  Surveys  (HRS)  covering 
the  characteristic  utilization  by  both  the  institutional  and  non-institutional 
population  of  the  nation's  health  man-power  and  health  facihties.  All  three  of 
these,  in  varying  degrees,  are  capable  of  measuring  morbidity  in  the  non- 
institutional  population  but  only  HIS  and  HRS  are  designed  to  measure  morbidity 
associated  with  hospitalization. 

To  provide  more  complete  and  precise  information  on  the  utilization  of  the 
nation's  hospitals  and  on  the  nature  and  treatment  of  illness  among  the 
hospitalized  population,  the  NCHS  began  in  1962,  an  exploration  of  the 
possibilities  for  surveying  morbidity  in  hospitals.  After  assembling  an  advisory 
group  and  reviewing  the  study  done  by  the  School  of  Public  Health  of  the 
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University  of  Pittsburgh,  and  with  the  advice  and  support  of  the  American 
Hospital  Association,  American  Medical  Association,  individual  experts,  elements 
of  the  Public  Health  Service,  the  National  Hospital  Discharge  Survey  was  started 
in  1964.  As  presently  arranged,  the  National  Hospital  Discharge  Survey  is  national 
in  scope,  continuing  in  nature,  concerned  with  the  general,  short  stay,  non-federal 
hospital  only,  and  based  on  existing  hospital  discharge  records.  In  addition  to  this 
information  on  the  hospital  and  its  record  keeping  system,  the  survey  obtains 
information  on  the  demographic  characteristics,  length  of  stay,  discharge  status, 
final  diagnoses,  and  surgical  procedures  from  the  National  Sample  of  Discharges 
from  short-stay  hospitals.  The  demographic  information  consists  of  sex,  data  of 
birth,  age,  race,  and  marital  status.  Length  of  stay  is  calculated  as  the  difference 
between  the  recorded  dates  of  admission  and  discharge.  Discharge  status  indicates 
whether  a  patient  survived  or  died  during  the  hospital  stay.  The  final  diagnoses  or 
surgical  procedures  for  each  hospital  episode  are  those  listed  on  the  face  sheet  of 
the  hospital  medical  record.  They  are  then  transcribed  to  an  NHDS  form  verbatim 
and  in  the  same  sequence  as  they  appear  on  the  face  sheet. 

The  survey  sample  consists  of  one  certainty  panel  of  all  hospitals  with  1 ,000 
or  more  beds  in  1963  plus  9  other  panels,  each  of  which  is  a  national  sample  of 
hospitals  with  fewer  than  1,000  beds.  When  properly  inflated  each  of  the  9 
sample  panels,  or  combinations  thereof,  when  added  to  the  certainty  panel,  are 
statistically  representative  of  all  short-stay  hospitals  in  the  United  States. 

Most  of  the  problems  of  the  survey  are  so  interrelated  that  it  is  virtually 
impossible  to  create  a  system  whose  components  are  mutually  exclusive.  The 
types  of  operational  and  medical  problems  are  described  below. 

Operationally,  it  has  been  difficult  to  develop  an  adequate  definition  of 
hospitals  for  the  survey.  Other  non-medical  problems  include  or  have  included 
processing  difficulties,  especially  with  regard  to  the  optical  scanning  form;  the 
item  on  race;  on  the  ever-present  NHDS  staffing  problem  for  analyzing  the 
accumulated  discharge  data. 

Primary  among  the  medical  problems  of  the  survey  is  that  related  to  first  — 
and  all  —  listed  diagnoses.  About  40  percent  of  the  discharges  and  probably  more 
than  70  percent  of  the  survey  processing  effort  and  cost  relate  to  these  multiple 
diagnoses.  This  becomes  a  problem  in  those  cases  where  the  attending  physicians 
elect  to  list  more  than  one  diagnosis  on  the  face  sheet  of  a  hospital  discharge 
record.  Some  physicians  will  record  a  maximum  number  of  diagnoses  per  patient, 
while  others  are  more  terse  in  filling  out  the  face  sheet  of  the  medical  record.  The 
problem  becomes  even  more  complex  when  surgical  procedures  are  involved.  Most 
hospital  records  do  not  specifically  relate  surgery  to  diagnosis  or  to  length  of  stay 
and  while  this  is  virtually  or  usually  apparent,  there  are  enough  variants  so  as  to 
confuse  the  statistical  picture. 
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The  conceptual  and  operational  problems  of  multiple  diagnosis  make  it 
difficult  not  only  to  tabulate  diagnoses  and  surgical  procedures  in  a  meaningful 
fashion,  but  also  to  analyze  and  to  evaluate  the  resultant  data.  The  potential 
multiplicity  of  certain  conditions  and  the  unitary  character  of  others  may  result 
in  overcounts  of  the  former  and  undercounts  of  the  latter,  e.g.,  one  hospital 
episode  of  cancer  may  include  several  diagnoses  of  malignant  neoplasms  covering 
all  affected  body  sites,  whereas  an  episode  of  mycardial  infarction  will  obviously 
include  only  one  such  diagnosis  and  only  one  site.  The  situation  is  further 
complicated  in  that  the  survey  data  are  cumulative  for  each  calendar  year. 
Therefore,  medical  conditions  requiring  repeated  hospitalizations  in  a  given  year 
may  overpresent  both  that  condition  and  the  involved  patients,  as  against  those 
patients  with  more  or  less  one-time  hospital  conditions. 

The  data  from  a  survey  are  in  demand  by  both  government  and  private 
sources.  The  Social  Security  Administration  has  used  them  to  validate  their  own 
data.  Numerous  requests  for  published  and  unpublished  data  have  also  been 
received  from  the  National  Academy  of  Sciences,  National  Heart  Institute, 
Chronic  Disease  Control  Programs,  various  state  agencies.  In  the  private  sector, 
numerous  requests  to  have  been  received  for  general  and  specialized  discharge 
data  including  medical  supply  and  marketing  research  organizations,  pharma- 
ceutical companies,  tobacco  industry  and  life  and  health  insurance  interest. 

During  the  past  few  years,  the  survey  data  collection  and  processing  system 
has  been  developed  and  improved.  Seven  reports,  based  on  non-medical  data  for 
1965,  have  been  published  and  distributed.  During  1968,  medical  data  for  the 
1965  discharges  became  available  for  analysis  and  in  1969,  non-medical  data  for 
the  calendar  year  1966;  and  in  1970,  the  remaining  medical  and  non-medical  data 
for  the  years  1966-1969  became  available  to  the  public. 

19.  Hospital  Discharge  Data  Collected  by  Blue  Cross  (84) 

Blue  Cross  Association  together  with  its  80  Blue  Cross  plans,  have  routinely 
collected  patient  discharge  statistics  and  related  hospital  charges  and  cost  data. 
These  data,  which  are  abstracted  from  patient  medical  and  business  office  records, 
are  reported  to  the  Blue  Cross  Organizations  through  claims  forms  and  periodic 
audits.  Such  information  includes  the  following: 

•  Name  of  hospital  or  provider  of  service. 

•  Name,  age,  sex,  marital  status,  and  residence  of  patient. 

•  Industry  in  which  the  patient  is  employed. 

•  Attending  and  referring  physician, 
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Admission  and  discharge  dates. 


•  Type  of  hospital  accommodations. 

•  Discharge  status. 

•  Admitting  and  discharge  diagnoses. 

•  Ancillary  services  received. 

•  Charges  for  services  rendered. 

•  Various  categories  of  hospital  costs. 

Once  the  data  have  been  collected,  they  are  processed  for: 

•  Administration  of  plan  activities. 

•  Management  of  national  accounts. 

•  Actuarial  rating  of  new  and  extended  and  medical  care  benefits. 

•  Claims  and  utilization  review. 

•  Data  services  for  utilization  review  committees. 

•  Research. 

Because  of  Blue  Cross's  awareness  that  programs  of  continued  research  and 
evaluation  are  essential  to  the  solution  of  the  problems  of  the  health  care  system, 
it  has  led  to  the  establishment  of  a  major  discharge  data  research  program  called 
the  National  Health  Care  Utilization  Study. 

The  study  is  an  ongoing  research  program  that  establishes  a  medical  care 
utiHzation  data  base  for  a  national  sample  of  approximately  50,000  Blue  Cross 
contracts  or  about  1 50,000  members.  The  data  base  is  composed  of  enrollment 
information  and  utilization  information  of  Blue  Cross  benefits  obtained  from  the 
claim  form  discharge  data.  The  primary  purpose  of  the  study  is  to  ascertain 
variations  in  hospital  and  other  medical  care  utilization  and  to  identify  and  study 
the  major  factors  influencing  this  variation. 
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Because  of  variations  and  inconsistencies  in  hospital  discharge  and  sub- 
scription information,  they  can  not  be  combined  on  a  national  basis.  These 
inconsistencies  are  broadly  categorized  as  problems  in  recording  utilization, 
enrollment  counts,  definitions  and  the  detail  in  which  the  information  is  obtained 
and  processed. 

In  regard  to  utilization,  some  plans  tabulate  the  number  of  discharges  on  an 
incurred  claim  basis,  while  other  plans  consider  only  paid  claims  in  their 
utilization  experience.  In  addition,  some  plans  may  consider  all  admissions  or 
discharges  by  an  individual  during  a  defined  interval  as  one  discharge.  Conversely, 
it  is  possible  at  some  plans,  that  they  will  report  a  continuous  stay  as  more  than 
one  discharge  if  the  stay  is  through  several  health  facility  billing  periods. 

The  primary  problem  in  determining  Blue  Cross  enrollment  is  the  availability 
of  information  and  the  method  by  which  such  determinations  are  made.  Some 
plans  use  contract  holder  and  the  department  information  available  in  their  status 
files,  which  may  or  may  not  be  current.  Other  plans  use  such  status  supplemented 
by  special  study.  To  complicate  this,  there  are  a  number  of  plans  which  do  not 
maintain  any  data  for  dependents.  For  these  groups,  enrollment  counts  generally 
are  obtained  by  multiplying  the  number  of  active  contracts  in  force  by  an 
estimated  average  family  size. 

Apart  from  these  inconsistencies,  is  the  fact  that  many  plans  do  not  tabulate 
enrollment  and  utilization  by  age  or  sex.  They  do  not  adequately  link  discharge 
data  or  utilization  experience  to  specific  members  in  the  family.  Finally,  plans 
generally  do  not  maintain  utihzation  information  in  excess  of  18  months. 

Through  the  National  Health  Care  Utilization  Study,  which  has  established  a 
file  containing  contract  and  subscriber  information  and  the  utilization  file,  nearly 
all  the  shortcomings  of  the  inter-plan  data  can  be  eliminated.  The  following  are 
the  data  to  be  collected  in  the  study: 

•  Blue  Cross  contract  classification  (group,  non-group). 

•  Benefits  available  (basic  contract  including  riders). 

—  Number  of  days 

—  Deductible  clauses 

—  Co-payment  requirements 

—  Co-insurance  features 

—  Hospital  room  allowance 

—  Inpatient  laboratory  and  X-ray  examination 

—  Inpatient  drugs  and  medications 

—  Anesthesia  administration 
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—  Maternity  allowance 

—  Number  of  hospital  days,  nervous  and  mental  conditions,  con- 
valescent care 

—  Various  outpatient  services,  including  psychiatric  care 

—  Maximum  age  for  dependents 

•  Name,  birth  date,  and  sex  of  contract  holder  and  dependents. 

•  Name  of  patient. 

•  Date  of  admission  or  service. 

•  Place  of  treatment. 

•  Type  of  treatment. 

•  Hospital  or  physician  number. 

•  Discharge  diagnosis. 

•  Number  of  days  or  visits  paid. 

•  Charges. 

—  Room  and  board 

—  Drugs 

—  X-ray 

—  Laboratory 

—  Other 

—  Total 

•  Total  charges  covered  under  Blue  Cross. 

The  type  of  information  to  be  tabulated  and  disseminated  on  a  regional 
national  basis  is  Hsted  briefly  as  follows: 

•  Total  Blue  Cross  membership  by  age,  sex,  contract  type,  and  benefit 
level. 

•  The  extent  of  changes  from  one  contract  classification  to  another. 

•  Hospital  admission  rates  and  average  length  of  stay  by  age,  sex, 
diagnosis,  contract  classification,  benefit  level,  place  of  treatment,  and 
type  of  treatment. 
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•  Distributions  of  various  lengths  of  stay  for  selected  diagnosis. 

•  Information  concerning  hospital  use  and  repeated  hospital  use  within  a 
specified  time  interval,  and  on  an  individual  and  family  basis. 

•  Analyses  of  possible  differences  in  hospital  utilization  by  type  of 
hospital. 

Furthermore,  the  establishment  of  a  data  base  will  permit  special  surveys 
concerning  determinations  of  selected  characteristics  of  the  Blue  Cross  population 
and  out-of-pocket  medical  care  expenditures,  including  those  related  to  hospital 
use  beyond  the  number  of  contract  days  of  care. 

The  principal  problems  encountered  in  setting  up  the  study  was  determining 
the  extent  to  which  the  required  discharge  data  were  available,  and  the  systems 
that  plans  could  use  to  report  such  data.  Also,  it  was  known  that  there  were 
regional  differences  in  definition.  To  clarify  these  problem  areas,  a  group  of 
personnel  from  ten  plans  assisted  in  resolving  the  differences,  setting  up  a  glossary 
of  terms,  formulating  a  compatible  set  of  codes,  and  suggesting  a  general  data 
processing  system.  Two  major  limitations  of  the  system  concern  the  inability  to 
determine  if  the  data  submitted  to  Blue  Cross  are  completely  accurate  and  the 
fact  that  the  study  was  presently  restricted  to  Blue  Cross  only.  In  regard  to  the 
former,  it  is  possible  that  incorrect  data  will  be  reported  which  will  pass  the  edit 
checks.  Special  studies  have  been  planned  to  ascertain  the  extent  of  errors. 

When  the  study  was  planned,  it  was  felt  that  a  more  meaningful  medical  care 
utilization  information  base  would  result  if  Blue  Shield  as  well  as  Blue  Cross  data 
were  obtained.  However,  Blue  Shield  was  not  included  since  it  would  have 
significantly  delayed  getting  the  study  underway  at  the  earliest  possible  time.  The 
primary  advantage  of  the  study  is  that  national  data  will  be  available  concerning 
the  type  and  extent  of  medical  care  utilization  on  a  longitudinal  basis  by  age  and 
sex  under  various  Blue  Cross  contracts.  Furthermore,  a  data  base  will  be 
established  that  permits  special  study  of  the  various  components  of  the  Blue  Cross 
population. 

The  national  and  regional  data  to  be  collected,  tabulated  and  analyzed  will 
provide  Blue  Cross,  hospitals,  health  insurance  organizations,  health,  welfare  and 
planning  association,  governmental  agencies  with  accurate  information  required 
for  planning  and  poUcy  determination.  The  information  in  conjunction  with 
similar  available  data  can  be  used  to: 

•  Identify  individuals  with  unmet  hospital  needs. 

•  Understand  current  and  predict  future  hospital  requirements. 
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Develop  new  and  extended  benefits. 


•  Prepare  utilization  profiles  by  diagnosis,  age,  sex,  type  of  hospital. 

•  Study  the  possible  effect  of  the  day  of  the  week  on  length  of  hospital 
stay. 

•  Study  variations  and  trends  in  hospital  charges  by  diagnosis. 

•  Study  variations  in  hospital  utilization  by  type  of  contract  and  benefit 
level. 

•  Determine  the  extent  of  multiple  hospital  admissions  during  the  stated 
time  interval  on  a  family  and  individual  basis. 

III.  UNIFORM  HOSPITAL  DISCHARGE  DATA  SET  (110) 

A.  PURPOSE 

Following  the  Airlie  House  Conference  Report,  a  Steering  Committee  was 
established  by  the  National  Center  for  Health  Services  Research  and  Develop- 
ment, to  investigate  the  objectives  set  forth  by  the  Conference  (to  be  discussed 
later).  The  National  Committee  on  Vital  and  Health  Statistics  was  charged  with 
the  establishment  of  a  subcommittee  to  study  the  uses  of  hospital  discharge  data 
in  detail  and  to  recommend  the  items  of  information  which  were  necessary  for  a 
basic  minimum  data  set  and  the  definitions  and  classifications  to  be  applied  in 
recording  the  information. 

In  January  1970,  the  NCHSR&D  awarded  a  grant  to  the  Health  Services 
Foundation  and  to  the  Blue  Cross  Association  for  a  two-year  (January  1970  to 
November  1972)  demonstration  project  for  the  development  and  implementation 
of  a  uniform  hospital  discharge  data  format.  The  project  was  charged  with 
carrying  forward  the  following  objectives: 

•  To  identify  and  define  the  minimum  uniform  basic  data  set  that  could 
be  used  in  hospital  discharge  abstract  systems;  to  improve  and 
coordinate  health  data  collection;  and  to  provide  basic  information 
which  can  serve  a  variety  of  functions.  These  functions  would  include: 
patient  management,  hospital  management,  health  planning  activities, 
health  services,  and  epidemiological  research,  and  insurance  claims 
processing. 
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•  To  identify  organizations  as  well  as  the  collection  and  processing  of 
patient  discharge  information  in  the  United  States. 

•  To  implement  tests  in  various  locations  to  establish  the  feasibihty  of 
collecting  the  basic  set  of  data  in  a  uniform  manner. 

•  To  provide  the  interregional  exchange  of  data  using  a  clearing-house 
approach. 

Information  on  patients  discharged  from  hospitals  is  presently  being 
collected  in  a  national  sample  by  the  hospital  discharge  survey  which  was 
previously  discussed.  One  study,  done  by  the  Hospital  Research  and  Educational 
Trust  and  the  American  Hospital  Association  (115)  indicates  that  there  were  87 
agencies  that  repeatedly  collected  discharge  data.  Health  data  abstract  agencies, 
which  comprised  7  of  the  87  agencies,  processed  the  largest  number  of  inpatient 
hospital  discharges  per  year  (14.4  million). 

The  other  agencies  that  routinely  collect  hospital  discharge  data  are  included 
in  the  following  categories: 

•  State  and  local  health  departments 

•  Areawide  health  planning  agencies 

•  Regional  Medical  Programs 

•  Blue  Cross  plans 

•  Insurance  companies 

•  Hospital  associations 

•  Medical  organizations 

•  Medical  education  institutions 

•  Paramedical  education  institutions 

Some  items  of  information  about  discharged  patients  are  essential  to  nearly 
every  stated  use  of  the  data,  such  as  diagnoses  and  procedures.  Other  items  are 
essential  for  particular  uses  of  the  data,  but  either  unnecessary  or  of  limited  value 
for  other  uses,  such  as  marital  status  or  date  of  procedure.  The  decision  to  include 
an  item  of  information  in  the  data  collected  by  an  abstract  agency  rests  on  the 
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judgment  as  to  its  necessity  for  particular  purposes  and  the  relative  importance  of 
those  purposes.  The  multiplicity  of  organizations  which  collect  these  data, 
sometimes  without  regard  to  common  information  assembly  and  interpretation, 
causes  major  differences  as  to  what  items  are  to  be  collected  and  to  the  precise 
meaning  of  these  items.  Due  to  this  lack  of  standardization,  comparability  of  data 
collected  is  extremely  limited. 

B.  UNIFORM  HOSPITAL  DISCHARGE  DATA  SET 

After  intensive  study  (110),  it  has  been  proposed  that  at  least  a  "minimum 
data  set"  be  gathered  routinely  for  all  hospitalized  patients.  The  Uniform  Hospital 
Discharge  Abstract  Data  Set  is  such  a  minimum  basic  data  set  and  its  vocabulary  is 
defined  in  terms  of  data  information  on  the  health  care  delivery  system: 

•  Uniform  —  always  having  the  same  content,  not  varying,  consistent, 
undiversified,  conforming  to  one  rule. 

•  Hospital  —  an  institution  where  medical  care  is  rendered. 

•  Discharge  —  information  about  a  patient  and  his  episode  of  illness 
which  was  summarized  in  the  hospital  medical  record. 

•  Minimum  —  the  least  number  of  information  items. 

•  Basic  —  essential  for  use  by  hospital  administrators,  planning  agencies, 
medical  staff,  third-party  payers  and  others. 

•  Data  set  —  items  of  information  summarized  from  the  hospital  medical 
record  often  contained  in  the  discharge  abstract. 

The  Subcommittee  of  the  National  Committee  on  Vital  and  Health  Statistics 
suggested  that  the  following  items  be  included  in  any  minimum  basic  data  set: 

•  Hospital  identification 

•  Person  identification 

•  Date  of  birth 

•  Sex 

•  Marital  status 

•  Race 
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•  Residence  —  zip  code 

•  Admission  and  discharge  date 

•  Physician  identification 

•  Diagnosis 

•  Procedures 

•  Service  to  which  the  patient  was  admitted 

•  Disposition  of  patient 

•  Principal  source  of  payment  (anticipated) 

•  Charges  (total) 

It  was  recognized  that  for  certain  purposes,  primarily  for  patient  manage- 
ment, this  data  set  would  be  the  focal  point  for  further  study  instead  of  yielding 
every  bit  of  information  that  might  eventually  be  required.  In  addition,  the 
minimum  data  set  might  have  to  be  augmented  to  serve  special  needs  in  local 
areas. 

C.  USES  OF  THE  MINIMUM  BASIC  DATA  SET 

The  establishment  of  such  a  minimum  basic  set  of  uniform  hospital  discharge 
data  would  permit  accumulation  and  comparable  patient  information.  The 
principal  institutions  and  agencies  requiring  access  to  information  on  health  and 
hospital  care  programs,  services,  utilization  costs,  include: 

•  Hospitals 

•  Local,  state,  regional  and  federal  health  planning  agencies 

•  Official  agencies  for  funding  and  licensure 

•  Third-party  payers 

•  State  and  federal  legislatures 

•  Universities  and  other  groups  involved  in  research 
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Accurate  and  comparable  data  are  needed  in  forms  that  are  adaptable  to  a 
variety  of  purposes  which  include: 

•  Common  claim  information 

•  Community  health  planning 

•  Evaluating  patterns  of  patient  care  and  providing  a  basis  of  continuity 
of  care  and  allocation  of  services  among  institutions 

•  Epidemiological  studies 

•  Predicting  the  impact  of  health  care  innovation,  such  as  rearrangements 
in  technology 

•  Internal  management  and  analysis  of  Health  Maintenance  Organizations 
and  external  evaluation  by  regulatory  agencies 

•  A  minimum  utilization  review  within  hospitals 

•  Quality  assurance  and  peer  review 

With  regard  to  the  last  item  on  peer  review,  hospital  discharge  abstract  and 
the  data  generated  from  them  have  long  played  important  roles  in  utilization 
review  activities  of  hospitals.  Hospital  discharge  abstract  data,  which  can  be 
formally  defined,  has  contributed  to  peer  review  activities  by  allowing  comparison 
with  patient  care  patterns  in  other  areas  of  the  country,  or  within  the  community 
and  in  the  hospital  itself.  Collected  on  all  discharged  cases,  these  data  provide  a 
framework  for  the  selection  of  cases  for  more  detailed  study.  Furthermore,  as 
similar  uniform  data  sets  are  developed  for  nursing  homes,  physician's  offices,  and 
other  delivery  areas,  the  total  health  quality  assessment  within  a  community 
becomes  more  feasible.  Also,  the  use  of  a  uniform  hospital  discharge  abstract  data 
set  could  be  substituted  for  items  now  called  for  on  a  third-party  claims  form, 
which  would  reduce  administrative  expense  and  claims  data  requirements. 

D.  REQUIREMENTS  FOR  IMPLEMENTATION 

The  Steering  Committee  on  Uniform  Hospital  Discharge  Data  recognized  the 
following  to  be  items  of  concern  in  introducing  this  concept: 

•  Resistance  to  change 

•  Confidentiality  of  patient  data  and  physician  data 
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•      Institutional  changes 


•  Existing  abstract  data  system 

•  Third-party  payers 

•  Cost 

Prior  to  the  adoption  of  the  minimum  basic  data  set  (or  adjustment  of 
existing  data  set  for  conformance)  sponsoring  organizations  must  assure  them- 
selves of  the  cooperation  of  all  parties  who  would  be  effected  by  the 
implementation.  These  include: 

•  Participating  hospitals 

•  Discharge  data  collection  agencies 

•  Medical  societies  and  hospital  medical  staffs 

•  Third-party  payers 

•  Areawide  health  planning  agencies 

•  Regional  Medical  Programs 

•  Hospital  associations 

•  Health  education  institutions 

It  has  been  estimated  that  these  activities  could  take  up  to  three  months  or 
more  of  consistent  effort  before  the  sponsoring  organization  could  begin  a  process 
of  implementing  a  uniform  hospital  discharge  abstract  data  set. 

The  following  preconditions  will  need  to  be  addressed  before  the  first  day  of 
operation.  They  are: 

•  Negotiations  with  existing  abstract  agencies  for  acceptance. 

•  Discussions  with  third-party  payers  for  the  possible  use  of  data  set  in  a 
claims  form. 

•  Education  of  hospital  personnel  as  to  the  nature  and  importance  of  the 
project. 

•  Coding  and  computer  programming  adjustments. 

301 


Arthur  D  Littlejnc. 


\ 


•  Development  of  new  forms  and  procedures. 

•  Training  of  hospital  personnel  with  respect  to  the  data  items, 
definitions,  forms,  data  gathering  techniques. 

It  has  been  estimated  that  the  time  needed  for  installation  is  dependent  upon 
the  sophistication  of  the  hospital's  current  data  gathering  activities,  presence  of 
abstracting  agencies,  and  the  processing  and  servicing  capacity  in  the  area.  It  has 
been  estimated  that  adjusting  the  data  requirements  of  the  uniform  data  set  will 
take  between  6  and  12  months  in  the  area  that  is  currently  served  by  hospital 
discharge  abstracting  agency.  If  such  an  agency  is  not  available,  more  time  would 
necessarily  be  required. 

IV.  COMMON  DATA  SET  FOR  HOSPITAL  MANAGEMENT  (118) 
A.  PURPOSE 

During  1970,  the  NCHSR&D  contracted  with  the  Hospital  Research 
Educational  Trust  (HRET)  and  the  American  Hospital  Association  to  design  and 
develop  areas  of  information  that  would  further  assist  the  implementation  of  the 
Airlie  House  Conference  recommendations  (to  be  discussed  later).  The  HRET 
contract  which  was  entitled  "Common  Data  Set  for  Hospital  Management"  had 
three  main  objectives: 

•  To  determine  the  present  state  of  collection  and  use  for  the  basic  data 
set,  or  of  most  items  of  the  set,  by  hospitals,  including  both  those  who 
subscribed  to  a  collecting  reporting  system  and  those  that  do  not. 

•  To  determine  the  capability  of  hospitals  to  collect  and  use  all  or  most  of 
the  data  set  items  if  not  presently  doing  so. 

•  To  propose  and/or  devise  training  programs  for  staffs  in  institutions  not 
presently  collecting  and  using  the  basic  data  set  in  order  to  bring  them 
to  a  level  of  capability  that  would  allow  them  to  do  so. 

The  contracts  with  both  the  Health  Services  Foundation  (HSF)  and  the  Blue 
Cross  Association  (previously  discussed)  and  the  Hospital  Research  and  Educa- 
tional Trust  were  developed  to  assist  in  the  implementation  of  the  Hospital 
Discharge  Abstract  Systems  Conference  recommendations.  The  contracts  inter- 
relate in  the  following  way:  The  focus  of  the  HSF  contract  was  on  existing 
discharge  abstract  systems  and  their  capacity  to  collect  and  use  the  basic  data  set, 
as  well  as  to  demonstrate  innovative  uses  of  the  data  primarily  by  agencies 
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external  to  the  hospital;  the  focus  of  the  HRET  contract  was  on  hospitals  and 
their  capacity  to  collect  and  use  the  basic  data  set,  as  well  as  to  propose  methods 
of  teaching  hospitals  how  to  develop  and  use  this  capacity,  if  non-existent. 

Five  steps  were  taken  by  HRET  to  develop  the  information  base  required  to 
accomplish  the  objectives  of  the  contract.  They  were: 

•  A  sample  of  community  hospitals  were  surveyed  by  mail  to  assess  the 
capability  of  those  hospitals  to  collect  and  use  the  basic  data  set,  as  well 
as  to  provide  insight  into  their  present  methods  of  discharge  data, 
collection  and  use. 

•  Allied  hospital  associations  were  surveyed  to  determine  their  actual  or 
planned  involvement  in  new  or  existing  hospital  discharge  abstract 
systems. 

•  The  hospital  discharge  abstract  systems  that  were  identified  by  the 
Health  Services  Foundation  were  requested  to  furnish  lists  of  their 
subscribing  institutions  in  order  to  provide  a  precise,  quantitative 
measure  of  the  number  of  hospitals  actually  participating  in  these 
programs,  as  well  as  to  provide  a  means  for  studying  characteristics  of 
system  participating  institutions. 

•  Data  produced  by  the  above  described  methodology  were  analyzed  to 
determine  the  characteristics  of  their  potential  subscribers  for  the 
educational  program.  Informal  conferences  were  held  with  education 
specialists  to  determine  methods,  both  innovative  and  traditional,  for 
conducting  such  an  education  program,  and  field  visits  were  made  to 
existing  discharge  data  systems  to  determine  their  methods  of  training 
personnel  in  hospitals  participating  in  their  ongoing  systems. 

•  A  short  conference  was  held,  with  selected  participants  from  the 
original  hospital  discharge  abstract  conference,  to  obtain  advice  and 
recommendations  concerning  the  development  and  progress  of  the 
contract. 

The  inquiries  to  community  hospitals,  hospital  associations  and  discharge 
abstract  systems  provided  information  to  fulfill  the  first  two  contractual 
requirements.  Site  visits  and  informal  conferences  provided  the  basis  for  fulfilling 
the  third  contract  requirements  in  development  educational  programs.  A  final 
conference  assisted  in  accomphshing  all  three  tasks. 
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B.  FINDINGS 


The  impetus  for  the  contract  originated  from  the  Airiie  House  Conference 
on  Hospital  Discharge  Abstract  Systems,  and  the  data  set  on  which  the  HRET 
contract  focused  was  originally  developed  primarily  for  use  by  abstracting 
systems.  This  contract,  however,  focused  primarily  not  on  abstracting  systems, 
but  on  individual  hospitals  which  may  or  may  not  participate  in  such  systems.  As 
a  result  of  the  differing  universe,  there  are  certain  considerations  concerning  data 
recording  and  collecting  that  may  not  be  hkely  to  be  present  when  all  systems  are 
considered. 

The  medical  record  of  the  individual  patient  is  considered  the  primary 
document  within  the  hospital  but  should  contain  at  least  the  information  required 
by  the  uniform  data  set.  For  reasons  of  economy,  continuity,  validity,  and 
reliability,  the  record  was  viewed  as  being  the  ultimate  storage  point.  It  is  from 
this  source  that  data  can  be  extracted  for  both  internal  and  external  institutional 
uses.  The  theoretical  logic  of  this  concept  does  not  hold  when  confronted  with 
the  real  world  of  hospital  organization.  For  example,  total  patient  charges  are  not 
normally  recorded  as  a  data  item  in  a  medical  record,  but  are  a  basic  and  integral 
record  item  within  the  accounting  office  of  the  hospital.  Furthermore,  the  utility 
of  correlating  data  on  charges  with  selected  items  of  the  medical  record  in  large 
numbers  of  hospitals  has  not  yet  been  demonstrated.  There  are  two  questions 
posed  by  this  situation;  namely: 

•  Is  the  medical  record  used  as  the  ultimate  storage  point  for  all  present 
and  future  items  of  the  data  set,  or 

•  Is  it  sufficient  to  assure  that  charges  and  other  similar  items  are 
routinely  available  within  the  hospital,  or  recorded  according  to 
prescribed  standards  and  definitions,  and  can  be  linked  with  the 
medical  record  when  necessary? 

Affirmative  response  to  the  first  item  would  require  an  internal  systems 
change  that  could  grow  to  be  expensive  and  somewhat  inaccurate.  Positive 
response  to  the  second  item  would  require  relatively  little  change  in  existing 
methods  and  probably  little  additional  expense.  This  discussion  was  used  only  as 
an  example  to  underscore  the  basic  consideration  set  forth  in  the  two  primary 
questions  posed. 

Existing  systems  require  that  participating  institutions  abstract  the  required 
data  and  forward  it  to  a  central  location  for  processing.  As  findings  demonstrate, 
the  large  proportion  of  institutions  do  not  currently  participate  in  discharge 
abstract  systems,  although  many  of  the  non-participating  institutions  routinely 
abstract  medical  record  data  for  their  own  internal  use.  This  significant  number  of 
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non-participants  must  be  considered  in  the  further  development  and  use  of  the 
data  set,  for  systems  uses  and  institutional  uses  may  be  at  considerable  variance 
and  ultimately  effect  the  goals  of  a  uniform  data  set. 


The  following  is  a  summary  of  the  HRET  contract  findings: 

•     Recording  of  Uniform  Data  Set  Items. 

The  community  hospital  study  appeared  to  conform  favorably  to  the 
requirements  of  the  18  elements  of  the  common  data  set.  At  least  95 
percent  of  all  hospitals  record  the  following  10  items: 

—  Patient  identification 

—  Date  of  birth 

—  Sex 

—  Admission  date 

—  Discharge  date 

—  Attending  physician 

—  Operating  surgeon 

—  Principal  diagnosis 

—  Other  diagnoses 

—  Surgical  procedures. 

At  least  85  percent  record  the  following  three  items: 

—  Marital  status 

—  Other  procedures 

—  Patient  disposition 

At  least  70  percent  record  race,  zip  code,  and  source  of  payment  and 
less  than  70  percent  of  the  hospitals  record  only  two  items  of  the  set: 

—  Admitting  service 

—  Charges. 

The  instances  of  nonrecording  relate  more  to  problems  stemming  from 
the  definitions  of  the  data  set,  and  its  newness  and  unfamiliarity,  than 
to  problems  stemming  from  the  hospital  medical  records  in  general. 
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•  Face  Sheet  as  Central  Recording  Source 

There  was  an  increasing  tendency  for  the  face  sheet  of  the  medical 
record  to  be  used  as  an  administrative  document  as  opposed  to  one  for 
medical  care  appraisal.  The  Common  Data  Set  is  comprised  of  medical 
items  of  information.  As  a  result  of  the  change  in  the  orientation  of  the 
recording  on  the  face  sheet,  the  total  array  of  documents  on  the 
medical  record  would  have  to  be  used  to  obtain  data  set  items,  rather 
than  the  face  sheet  exclusively.  However,  at  least  90  percent  of  the 
hospitals  commonly  record  6  items  of  the  set  routinely  on  the  face 
sheet. 

•  Disease  and  Operation  Coding  Systems 

There  is  a  wide  variation  of  the  system  used  (7  different  systems  were 
reported),  and  at  least  15  percent  of  the  hospitals  used  more  than  one 
system  of  coding. 

•  Hospital  Membership  in  Discharge  Abstract  Systems 

Slightly  more  than  one-fourth  of  all  community  hospitals  were 
members  of  at  least  one  abstract  system,  but  these  system  members 
account  for  almost  40  percent  of  all  community  hospital  beds.  This  is 
illustrative  of  the  fact  that  the  membership  of  existing  systems  tends  to 
be  drawn  from  the  larger  community  hospitals,  especially  those  with 
over  200  beds.  The  tendency  for  larger  hospitals  to  elect  a  joint  abstract 
system  is  true  for  all  the  larger  categories  of  the  hospital  size,  except  for 
the  largest  (500+).  As  a  correlation  to  the  large  size,  hospitals 
participating  in  the  systems  have  a  greater  proportion  of  approved 
medical  educational  programs  than  do  hospitals  not  participating. 

The  data  recorded  on  the  medical  records  of  these  hospitals  participat- 
ing in  these  systems  may  not  totally  conform  to  the  requirements  of 
the  Common  Data  Set,  but  they  must  conform  to  the  data  require- 
ments and  definitions  of  the  abstracting  systems.  Changes  in  the 
recording  of  the  data  set  of  these  hospitals  must  therefore  be 
approached  through  the  systems  organizations  rather  than  through  the 
individual  hospital  organization. 

•  Hospitals  with  Individual  Systems 

Over  40  percent  of  all  community  hospitals  have  designed  individual 
abstract  systems  for  their  own  internal  use,  although  they  do  not 
participate  in  a  group  system.  Hospitals  with  less  than  200  beds  and 
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with  those  with  500  or  more  tended  to  favor  this  type  of  system  over 
existing  groups.  In  terms  of  individual  items  abstracted,  there  is 
considerable  variation  among  the  hospitals;  but  at  least  half  of  the 
institutions  routinely  abstract  1 1  of  the  1 8  data  set  items. 

•  Hospitals  Not  Using  Any  Type  of  Abstracting  System 

Almost  one-third  of  all  community  hospitals  report  that  they  neither 
belong  to  an  existing  hospital  discharge  abstract  system  nor  routinely 
abstract  medical  records'  data  for  their  own  internal  use.  Practically  all 
these  hospitals  have  less  than  100  beds.  There  is  no  hospital  with  more 
than  200  beds  that  does  not  use  any  type  of  system  for  abstracting 
medical  record  data  items. 

•  Use  of  Data  Items  A  bstracted  from  Medical  Records 

Hospitals  belonging  to  abstract  systems  and/or  using  their  own  internal 
method  report  a  wide  range  of  functional  uses  of  items  abstracted.  The 
most  frequently  occurring  uses  are  for  purposes  of  indexing  in  registries 
and  of  patient  care  review.  Despite  the  fact  that  over  two-thirds  of  the 
hospitals  participate  in  some  type  of  abstracting,  there  are  indications 
that  there  is  a  wide  range  of  possible  functional  uses.  The  number  of 
hospitals  actually  using  the  abstracted  data  beyond  the  traditional 
indexing  and  patient  and  medical  care  review  is  minimal.  Among 
hospitals  which  develop  their  own  system,  half  of  the  functions 
reported  were  used  by  less  than  50  percent  of  the  hospitals.  The  same 
pattern  was  observed  in  the  group  systems  hospitals. 

•  Allied  Hospital  Association  Involvement  in  Discharge  Abstract  Systems. 

Over  one-fifth  of  the  allied  hospital  associations  indicated  some  degree 
of  involvement  with  discharge  abstract  systems.  Most  of  the  associa- 
tions reported  involvement  with  new  or  developing  systems.  Twelve 
associations  indicated  involvement,  but  eight  additional  groups  indi- 
cated that  serious  planning  was  under  way  for  development  of  new 
systems  at  both  state  and  metropolitan  levels. 

C.  HRET  RECOMMENDATIONS 

1.  It  was  recommended  that  action  be  taken  by  appropriate  national 
organizations  to  disseminate  information  on  the  uniform  data  set  and 
definitions  to  health  care  institutions.  Further  relevant  educational 
activities  should  be  undertaken  in  these  institutions  to  insure  that  data 
are  collected  and  that  the  collections  are  appropriate  in  terms  of  both 
quality  and  quantity. 
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It  was  found  that  the  majority  of  institutions  appear  to  be  collecting 
most  items  on  the  data  set,  but  they  were  not  necessarily  using 
appropriate  definitions  and/or  data  categories.  It  was  believed  that 
general  and  continuous  dissemination  of  information  and  educational 
activities  may  overcome  this  problem. 

2.  It  was  recommended  that  certain  items  on  the  data  set  be  reconsidered 
by  the  developing  organization.  This  reconsideration  is  focused  both  on 
the  required  items  of  the  set  and  on  certain  definitional  areas. 

It  was  found  that  certain  items  of  the  set  are  inappropriate  in  the 
medical  record  (e.g.,  charges).  Certain  items  that  are  not  set  down  on 
the  record  can  be  made  available  through  it  (e.g.,  zip  code). 

3.  It  was  recommended  that  an  investigation  be  undertaken  to  determine 
the  functional  uses  of  the  abstracted  data,  especially  observed  in  the 
low  use  areas  (i.e.,  administration  and  planning).  Uniformity  in 
recording  is  basically  important  only  when  the  items  recorded  are  used. 
The  level  and  types  of  use  for  the  items  did  not  appear  to  justify  the 
major  effort  to  institute  uniform  recording  without  participation  of 
functional  uses. 

4.  It  was  found  that  32  percent  of  the  hospitals  reported  that  they  make 
no  use  at  all  of  the  data  abstracted  from  medical  records.  On  the 
assumption  that  positive  action  has  been  taken  on  the  previous 
recommendation,  it  was  recommended  that  attention  be  given  to 
institute  a  system  of  uniform  reporting,  and  implementation  of  means 
and  purposes  of  using  the  data  set  in  these  hospitals. 

5.  It  was  recommended  that  appropriate  national  organizations  be  urged 
to  attempt  to  bring  about  uniformity  in  the  codes  used  for  recording 
diseases  and  operations  and  to  move  hospitals  toward  common  use  of  a 
unit  record  system. 

6.  It  was  recommended  that  a  periodic  survey  of  allied  hospital  associa- 
tions be  continued  to  determine  the  extent  of  change  occurring  in  their 
participation  in  hospital  discharge  abstract  systems.  The  information 
provided  in  a  survey  should  include  a  description  of  the  nature  of  the 
involvement  in  information  concerning  the  content  and  organization  of 
the  system. 
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7.  It  was  recommended  that  more  positive  steps  be  taken  to  set  up  an 
information  exchange  among  the  associations  concerning  abstract 
systems.  It  was  believed  that  the  experience  of  currently  active 
associations  could  greatly  benefit  those  other  groups  currently  consid- 
ering development,  and  could  motivate  other  associations  toward  its 
involvement. 

8.  It  was  recommended  that  a  study  be  conducted  to  identify  factors 
related  to  hospital  nonparticipation  in  existing  discharge  systems.  It  was 
assumed  at  the  Airlie  House  Conference  that  the  maximum  benefits 
from  uniform  data  would  accrue  to  hospitals  participating  in  the 
system,  rather  than  operating  independently.  If  the  maximum  benefit  is 
to  occur,  the  number  of  system  hospitals  should  be  increased.  To 
accomplish  this  change,  it  must  be  determined  why  certain  institutions 
do  not  now  join  systems,  and  why  certain  institutions  join  systems  and 
then  terminate  membership.  If  factors  creating  the  failures  are 
determined,  it  would  then  be  possible  to  institute  system  changes  to 
overcome  the  resistance  to  membership. 

9.  It  was  recommended  that  further  information  be  gathered  on  demon- 
strated institutional  benefits  of  present  membership  in  discharge 
abstract  systems. 

10.  It  was  recommended  that  an  educational  program  be  established  for 
three  categories  of  learners: 

—  Physicians  and  administrators 

—  Medical  records  hbrarians  or  other  persons  who  will  have  direct 
responsibility  for  bringing  out  changes 

—  Clerical  workers  to  be  trained  and  retrained 

11.  It  was  recommended  that  a  study  be  conducted  to  determine  the  value 
of  a  uniform  data  set  internal  to  an  institution. 

1.2.   It  was  recommended  that  a  group  of  institutions  be  selected  from  the 
universe  to  serve  as  demonstration  hospitals  for  the  uniform  data  set. 

V.  AMBULATORY  HEALTH  DATA  SYSTEMS 

Based  on  prior  experience  in  the  conduct  of  research  and  administration  of 
ambulatory  services,  it  has  been  recognized  that  there  is  need  for  improvement  in 
the  methods  of  collecting  and  processing  data  in  this  setting.  Existing  clerical  and 
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clinical  records  have  proven  to  be  inadequate  for  the  purposes  of  either  program 
planning  or  research.  Special  surveys,  samphng  techniques  and  questionnaire 
interview  methods  which  were  characteristic  of  earlier  attempts  to  obtain  data  for 
the  analyses  of  ambulatory  operations  are  now  too  costly  and  time  consuming  to 
permit  continued  study  and  review  of  this  most  important  area  of  medical  care. 
This  section  of  the  paper  is  intended  to  describe  several  efforts  in  obtaining 
patient  data  on  ambulatory  care  for  administrative,  peer  review,  and  research 
purposes.  The  descriptions  that  follow  are  intended  to  provide  an  overview  of 
differing  approaches  of  various  operations  and  is  not  intended  to  be  a  complete 
inventory  of  ambulatory  health  data  systems.  The  tendency  for  ambulatory 
services  to  be  institutionally  or  group-practice  based  has  placed  increasing 
emphasis  on  the  medical  record  as  the  central  instrument  for  continuity  of  care. 
The  record  itself  is  the  most  viable  source  of  data  for  peer  audit  and  evaluation 
and  for  rational  patient  and  administrative  management.  In  recent  years,  the 
computer  has  been  used  in  the  processing  of  medical  records  to  serve  these 
functions.  While  some  computer  systems  have  been  developed  with  extensive  data 
bases  on  a  Hmited  number  of  patients  which  either  help  to  manage  single  disease 
ease  entities  or  to  help  teach  in  guide  clinical  care  delivery,  other  systems  with 
limited  data  bases  have  been  developed  on  large  populations  to  facilitate 
administrative  planning  and  epidemiological  and  clinical  research. 

A.  THE  BASIC  NEIGHBORHOOD  HEALTH  CENTER  DATA  SYSTEM  (198) 

The  basic  neighborhood  health  center  data  system  is  a  fully  operational 
information  system  consisting  of  three  data  collection  forms  and  a  set  of 
computer  programs  designed  for  comprehensive  ambulatory  health  facilities.  It 
was  developed  by  Biodynamics,  Inc.  under  contract  389-4368  with  the  Office  of 
Economic  Opportunity.  The  system  measures  characteristics  of  families  and 
patients  being  served  in  addition  to  the  services  received.  These  data  are  recorded 
and  processed  using  an  integrated  information  approach,  where  a  variety  of  uses 
and  functions  can  be  served  by  one  system. 

This  health  information  system  is  based  on  a  systems  analysis  of  patient 
flows  and  program  goals  from  a  number  of  OEO  neighborhood  health  centers.  It 
is  not  based  on  either  inpatient  procedures  of  health  care  delivery  nor  on 
traditional  outpatient  procedures.  It  was  designed  to  assist  individual  centers  in 
improving  their  ability  to  deliver  ambulatory  care  on  a  community  basis  and  to 
guide  them  into  relatively  new  fields  of  operations  research,  computers,  and 
systems  analysis  as  well  as  biostatistics.  The  system  was  also  designed  to  gather 
comparable  data  from  all  centers  in  the  OEO  program  to: 

•  centrally  monitor  the  system 

•  investigate  different  modes  of  outpatient  health  care  delivery 
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•  analyze  the  ability  of  the  health  centers  to  deliver  comprehensive 
family  oriented  care. 

The  development  of  this  data  system  began  over  four  years  ago  when  there 
were  no  operational  automated  ambulatory  care  data  systems,  with  the  exception 
of  special  research  projects.  The  goal  was  to  provide  an  operationally  useful  and 
replicable  data  system  for  ambulatory  facilities  throughout  the  United  States. 
There  was  no  desire  to  re-invent  the  wheel;  and  reviews  of  the  literature  and  site 
visits  were  made  of  supposedly  operational  data  systems  in  the  ambulatory  care 
arena.  The  review  did  not  uncover  a  single  system  which  was  either  fully 
operational  or  replicable.  Furthermore,  the  data  being  collected  were  not 
compatible  and  did  not  have  appropriate  denominators.  Few  facilities  used  the 
same  definitions  of  such  basic  terms  as  registration  and  visit,  or  knew  the  age-sex 
distribution  of  individuals  registered  for  the  service  in  their  institution. 

For  these  reasons,  Biodynamics  undertook  the  development  of  this  system. 
Since  there  was  no  system  which  could  be  adapted  to  neighborhood  health 
centers,  OEO  sponsored  the  development  of  this  health  information  system  with 
the  charge  that  it  must  be  both  basic  and  replicable.  The  primary  objective 
resulting  from  the  basic  neighborhood  health  data  system  was  to  supply 
information  that  administrative  and  medical  directors  of  these  facilities  need  to 
efficiently  operate  their  programs  and  provide  high  quality  care  to  their  patients. 
Two  other  issues  that  were  addressed  were  the  cost  of  providing  these  services  to 
individuals  and  families  and  the  development  of  data  for  a  setting  of  capitation 
rates  under  a  pre-paid  system. 

The  components  of  the  system  are  the  registration  and  encounter  forms  and 
the  computer  to  process  the  information  on  these  forms  in  various  outputs  for 
various  users.  These  components  form  an  integrated  information  system  through 
the  collection  of  basic  input  data  and  the  use  of  modular  design  techniques.  The 
system  is  an  integrated  one  in  two  ways:  with  respect  to  those  whose  needs  it 
serves  and  with  respect  to  the  functions  it  performs.  The  system  serves  the  needs 
of  the  health  programs  themselves  while  simultaneously  providing  the  information 
needed  by  OEO  to  effectively  monitor  and  evaluate  the  neighborhood  health 
center  program.  In  addition,  it  is  a  single  system  having  five  functions: 

•  Basic  utilization  and  registration  statistics 

•  Management  monitoring  and  control  information 

•  Billing  information 
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•  Program  evaluation  and  planning  information 

•  Research  and  reports 

Basic  input  data  are  collected  in  such  a  way  that  all  of  these  diverse  outputs 
can  be  produced  by  one  system.  There  are  no  separately  collected  data  to  serve 
the  needs  of  just  one  of  the  five  functions  or  to  meet  the  reporting  requirements 
of  one  group.  All  input  data  are  processed  and  maintained  in  the  basic  form  so 
that  they  can  be  aggregated  as  needed  to  serve  various  functions  of  users.  Data 
collection  concentrates  on  basic,  generic,  non-duplicated,  and  accurate  input  data; 
computing  processing  concentrates  on  editing,  storing,  merging,  aggregating, 
analyzing,  and  displaying  the  data. 

The  components  of  the  system  are  modular  in  order  to  insure  that  the 
system  will  suit  the  needs  of  various  ambulatory  health  care  facilities  in  an 
integrated  manner.  Items  of  information  or  entire  data  collection  forms,  as  well  as 
computer  programs  and  outputs,  can  be  added  to,  or  deleted  from  the  basic 
system  as  a  core,  resulting  in  small  or  dramatic  changes  in  the  scope  of  the  system. 
Essentially  this  means  that  the  system  has  the  capability  to  be  tailored  to  each 
health  care  facility's  informational  needs,  without  recourse  to  the  non-integrated 
approach  of  using  a  separate  system  to  produce  output  not  produced  by  the 
standard  basic  data  system. 

The  three  data  collection  forms  used  in  the  basic  system  are: 

•  Family  registration  form 

•  Individual  registration  form 

•  Health  services  encounter  form 

The  family  registration  form  is  used  to  enroll  a  family  for  health  care  in  the 
neighborhood  health  center.  It  is  used  to  collect  information  about  the  family  as  a 
unit,  to  determine  a  family's  eligibility  for  care,  and  to  assign  a  family 
identification  number  (and  family  member  numbers)  to  an  eligible  family.  A 
family  is  defined  to  be  two  or  more  people  living  within  one  housing  unit  who  are 
related  by  blood,  marriage  or  adoption,  and  one  person  living  without  relatives. 
Socially-related  individuals  who  are  economically  dependent  on  the  head  of  the 
family  and  foster  children  may  be  considered  part  of  the  family  if  a  center  wishes 
to  do  so.  The  family  registration  form  is  completed  only  once  for  each  family, 
and  the  data  on  it  are  not  collected  again  after  each  individual  in  the  family  is 
registered. 


312 


Arthur  D  Littlejnc. 


The  individual  registration  form  is  used  to  register  separately  each  member 
of  the  family  for  health  care  by  recording  only  data  which  are  specific  to  that 
individual  such  as  name,  date  of  birth,  and  sex.  The  individual  registration  form 
can  also  be  used  to:  notify  the  medical  record  section  to  start  a  medical  record 
for  a  new  patient;  initiate  the  preparation  of  the  patient's  plastic  identification 
card;  and,  schedule  an  appointment  for  the  initial  health  assessment. 

The  health  services  encounter  form  is  used  to  collect  data  on  health  services 
provided  or  ordered  at  the  center.  One  copy  of  the  health  service  form  is 
completed  for  each  encounter.  An  encounter  is  defined  as  a  face-to-face  meeting 
between  a  patient  and  a  health  care  provider,  that  results  in  the  delivery  of  a 
significant  service  to  the  patient. 

This  health  services  form  purposely  calls  for  a  limited  but  very  useful 
amount  of  health  services  utilization  data  so  that  a  center  can  quickly  initiate  the 
systematic  collection  of  such  data.  It  concentrates  on  collecting  the  highlights  of 
services  provided  a  patient  rather  than  recording  every  detail  of  all  services 
rendered. 

The  data  collection  forms  share  the  following  design  features: 

•  Ease  and  dispatch  of  filling  out  and  handling 

•  Usefulness  to  the  center 

•  Suitability  for  economical,  computer  processing 

•  Flexibility  for  accommodating  special  centers 

The  basic  systems  computer  processing  component  contains  a  set  of  eight 
programs  for  processing  the  registration  and  health  services  data  collected  on  the 
three  forms  in  the  system.  The  programs  create  and  update  computer  files, 
error-check  incoming  data,  produce  Usts  of  information,  and  compute  statistical 
tables.  They  usually  run  for  monthly  and  quarterly  reporting  periods,  but  can  be 
run  for  any  special  needs. 

Computer  files  containing  registration  and  health  services  data  form  the 
center's  data  base.  Error  messages  are  produced  for  feed  back  to  the  center 
personnel  who  fill  out  the  forms,  as  part  of  a  continuing  training  program  to 
assure  the  accuracy  of  input  data,  and  long-term  effort  to  maintain  an  accurate 
data  base.  The  output  lists  and  tables  are  extracted  from  the  data  base  to 
accomplish  the  five  functions  of  the  system: 
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Basic  utilization  and  registration  statistics 


•  Management  monitoring  and  control  information 

•  Billing  information 

•  Program  and  planning  evaluation 

•  Research  and  reports. 

These  outputs  are  in  a  form  suitable  for  operational  use  as  well  as  for  direct 
inclusion  in  reports. 

In  addition  to  the  standardized  lists  and  tables  of  the  basic  system,  the  data 
base  itself  also  provides  a  source  of  additional  information  for  any  center.  It  is 
possible  to  enhance  the  usefulness  of  the  basic  system  once  the  center  has 
established  an  adequate  data  base  by  tapping  that  base  in  different  ways  in  order 
to: 

•  Produce  additional  tables  cross-relating  or  summarizing  any  of  the  data 
in  the  base  into  different  ways  as  dictated  by  the  needs  of  the  center 

•  Produce  additional  lists  of  information 

•  Select  samples,  either  randomly  or  based  on  selected  criteria 

•  Perform  special  analyses  or  studies. 
The  standard  outputs  of  the  basic  system  are: 

•  The  data  base,  consisting  of  updated  family  and  individual  registration 
and  health  service  encounter  files 

•  Error  messages 

•  Four  lists 

•  32  statistical  tables 

Each  time  the  data  base  is  updated  by  the  addition  of  new  registrations  and 
by  the  incorporation  of  changes  for  old  registrations,  such  as  error  corrections, 
completely  new  lists  of  patients  and  families  are  produced  for  administrative  and 
operational  use  by  the  center  personnel. 
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The  32  standard  statistical  tables  of  the  basic  system  provide  multi- 
dimensional family  registration,  individual  registration,  and  health  services 
tabulations  that  contain  more  information  than  are  provided  by  most  common 
one-dimensional  tabulations  of  key  punched  data.  Ten  of  the  tables  are 
cross-tabulations  on  the  family  registration  form.  The  family  registration  tables 
provide  a  geographic,  economic,  and  profile  of  the  families  reached  by  the  center. 
The  profile  can  be  monitored  from  time  period  to  time  period,  spot  trends  or 
sudden  changes,  and  can  be  compared  to  survey  and  census  data  for  the  area  to 
determine  whether  the  center  is  reaching  those  groups  within  the  target  area  it 
wants  to  serve. 

There  are  12  individual  registration  tables  in  the  basic  system.  The  first  one 
provides  an  age,  sex,  and  race  breakdown  of  all  the  center's  registrants  up  to  the 
end  of  the  reporting  period.  Individuals  registered  prior  to  that  time  are 
enumerated  separately  from  those  registered  during  the  period,  and  the  total 
number  of  different  families  represented  by  the  tabulated  individuals  is  given  at 
the  end  of  the  table. 

Data  about  the  center's  registered  individuals  provide  information  on  whom 
the  center  is  reaching.  They  can  be  used  to  compare  with  other  target  population 
data  to  determine  who  is  being  missed,  and  to  match  against  center  priorities  to 
determine  if  they  are  being  met.  The  age,  sex,  race  distribution  of  registrants  has 
two  other  important  uses: 

•  Provision  for  predicting  the  overall  types  of  morbidity  and  social 
pathology 

•  Used  to  develop  expected  utilization  rates 

The  purpose  of  the  ten  health  services  tables  is  to  provide  information  on  the 
key  elements  of  patient  care:  who  provides  what  types  of  care  to  whom  and  how 
frequently.  Such  utilization  of  services  and  staff  workload  data  are  essential  for 
proper  management  monitoring  and  control  of  services  provided  and  are  necessary 
for  center  planning  and  evaluation.  These  health  services  tables  deal  with  the  type 
of  encounter,  selected  medical  and  dental  services  provided,  referrals  requested, 
and  home  encounters. 

The  basic  neighborhood  health  center  data  system  and  its  uses  can  be 
summarized  as  follows: 

•  Assist  in  the  control  of  patient  and  record  flow  and  the  maintenance  of 
accurate  records 

•  Support  outreach  activities  and  assist  in  evaluating  effectiveness 
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Provide  operational  data  on  utilization  of  services,  patient  characteris- 
tics, workload  levels,  and  payment  sources 


•  Generate  statistical  tables 

•  Create  and  maintain  a  central  data  base 

•  Provide  information  for  billing 

•  Provide  data  for  review  and  improvement  of  operational  procedures  and 
the  control  of  operations 

•  Assist  in  the  implementation  of  program  goals 

•  Provide  information  for  evaluation  and  revision  of  program  goals  and 
priorities 

•  Provide  operationally  useful  data  collection  forms,  information  lists, 
and  statistical  summaries 

•  Support  clinical  operations  and  monitor  key  elements  of  patient  care 

•  Monitor  services  rendered,  staff  workloads,  referrals,  and  appointments 

•  Identify  operational  problems,  inadequate  service  areas,  and  unmet 
patient  needs 

•  Supply  information  needed  for  staff  organization  and  planning 

•  Provide  data  for  research,  special  studies,  analyses  of  trends,  reports, 
and  evaluation 

•  Provide  utiHzation  data  which  can  be  related  to  cost  data. 

B.  AUTOMATED  MEDICAL  RECORD  SYSTEM  OF  THE  LABORATORY 
OF  COMPUTER  SCIENCES,  MASSACHUSETTS  GENERAL  HOSPITAL 
AND  THE  HARVARD  COMMUNITY  HEALTH  PLAN  (103) 

The  Automated  Medical  Record  System  (AMRS)  has  been  operational  at  the 
Harvard  Community  Health  Plan  (HCHP)  in  Boston  since  October  1,  1969.  This 
system  has  processed  data  for  the  prepaid  group  practice  for  all  of  the  80,000 
visits  of  the  20,000  prepaid  members  and  1,000  fee-for-service  patients.  The 
medical  record  consists  primarily  of  computer-generated  reports  which  are  stored 
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in  a  traditional  medical  record  folder.  Data  for  these  reports  are  obtained  from 
what  is  called  an  "encounter  form"  which  is  filled  out  by  the  health  provider  at 
the  time  of  each  visit.  Information  is  provided  in  four  basic  areas: 

•  Diagnostic  impression,  which  may  be  specific  diagnoses,  non-specific 
impressions,  or  psycho-social  concerns  of  the  patient 

•  Diagnostic  tests  (included  on  a  separate  sheet  which  accompanies 
enounter  form) 

•  Therapy 

•  Disposition 

All  nine  medical  specialties  as  well  as  nursing,  social  service,  and  triage  have 
individual  encounter  forms,  but  they  all  share  the  same  common  format.  The 
diagnostic  impressions,  tests,  and  therapies,  were  selected  from  the  most  common 
ones  appearing  in  the  review  of  past  data.  The  provider  checks  off  the  appropriate 
items  on  the  form  and  is  allowed  space  to  add  any  unlisted  items  which  are 
necessary  for  proper  recording  of  the  care  rendered.  Each  provider  also  has  the 
option  of  dictating  additional  information  about  the  visit,  which  is  transcribed 
and  pasted  in  the  record. 

The  medical  record  contains  two  types  of  computer-generated  reports:  (1) 
an  encounter  report,  and  (2)  a  status  report.  The  encounter  report  contains 
information  from  a  single  visit  to  a  single  provider  and  is  the  equivalent  of  a 
progress  note.  The  content  and  format  still  remain  the  same  regardless  of  specialty 
(diagnoses,  tests,  therapy,  and  disposition).  Typed  dictation  is  also  affixed  to  the 
bottom  of  this  report.  Although  a  new  page  for  each  encounter  is  stored  in  the 
medical  record,  yearly  summaries  of  patient  encounters  will  be  used  to  replace 
these  individual  ones. 

A  new  status  report  is  also  generated  each  time  information  is  put  into  the 
system.  This  report  contains  all  of  the  information  which  is  necessary  for  quick 
reference  to  the  patient's  condition.  It  is  essentially  an  updated  summary  of  the 
patient's  medical  status,  including  all  facts  of  diagnoses  and  problems,  latest  test 
results,  and  current  medications. 

These  encounter  reports  are  clipped  into  the  medical  record  on  the  left  side 
in  chronological  order  (recent  on  top);  each  new  status  report  replaces  the 
previous  one  and  is  clipped  to  the  right  side  of  the  folder.  This  allows  the  provider 
in  reviewing  the  record,  a  chronological  summary  of  the  patient's  progress  on  the 
left  and  a  single  status  report  on  the  right  which  summarizes  important  data  from 
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all  visits.  As  a  recent  addition,  the  Harvard  Community  Health  Plan  is  now 
experimenting  with  the  use  of  CRT's  which  are  located  in  specific  delivery  areas 
for  quick  retrieval  and  display  of  status  reports. 

If  a  patient  is  hospitalized,  a  copy  of  the  status  report  and  other  pertinent 
records  are  forwarded  to  the  hospital  prior  to  admission  to  facilitate  the  workup 
period.  While  the  patient  is  hospitalized,  the  traditional  hospital  medical  record  is 
kept  until  discharge.  A  structured  summary  of  the  hospitalization  is  then  prepared 
for  data  entry  into  the  AMRS. 

Forms  completed  by  the  providers  are  returned  to  the  medical  record  room 
and  are  entered  into  the  computer  by  a  clerk.  The  computer  checks  coding  and 
vocabulary  at  the  time  of  input.  New  encounter  and  status  reports  are  generated 
during  the  night  and  are  subsequently  filed  into  the  medical  record  folder.  Before 
the  record  is  returned  to  the  general  file,  the  provider  verifies  and  signs  the  new 
encounter  report.  Lab  data  are  entered  through  a  terminal  located  in  the 
laboratory  with  the  computer  integrating  the  test  result  data  with  the  encounter 
form  data.  Registration  data  are  entered  by  computer  input  form  which  is 
separate  from  the  medical  data. 

A  medium-sized  computer  system  which  is  located  at  the  Laboratory  of 
Computer  Science  at  the  Massachusetts  General  Hospital  is  used  to  process  the 
records.  Off-site  terminals  in  the  record  room  of  the  Harvard  Community  Health 
Plan  are  connected  to  the  computer  by  leased  telephone  wires. 

Generation  of  statistical  reports  requires  no  further  data  collection  or  input. 
These  tables  are  designed  to  serve  the  needs  of  multiple  groups:  medical  director, 
individual  providers,  health  center  administrators.  Plan  administrators,  and 
evaluators.  The  tables  currently  produced  fall  into  four  classes: 

•  Medical  aggregates  —  lists  of  diagnoses,  test  ordered,  and  medications 
prescribed,  in  order  of  their  frequency,  are  produced  for  each  staff 
member,  each  specialty,  and  for  the  entire  plan. 

•  Utilization  —  aggregate  tables  are  broken  down  by  care  provider, 
specialty  visited,  and  by  frequency  of  visits.  They  are  cross  tabulated 
with  demographic  data  such  as  age,  sex,  date  of  registration,  and 
duration  of  membership. 

•  Membership  data  —  alphabetic  lists  of  membership  groups  and  aggregate 
tables  of  the  characteristics  of  the  membership  population  can  be 
produced. 
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•     Special  studies  —  information  can  be  selected  from  computer  files 
regarding  any  group  of  patients  whose  records  meet  defined  criteria. 

The  most  fundamental  change  which  accompanies  computerization  of  the 
medical  record  is  the  standardization  of  the  content  and  structure.  This  change  in 
itself  accounts  for  many  of  the  advantages  and  drawbacks  of  an  automated 
system.  The  principal  benefit  of  standardization  is  the  ability  to  summarize  data. 
This  has  been  demonstrated  in  HCHP  in  the  status  report  which  summarizes 
information  for  many  encounters  to  provide  the  physician  with  a  concise, 
updated  summary  of  the  patient's  current  problems.  It  is  obvious  that  this  offers  a 
distinct  advantage  over  the  classical  paper  system  where  such  a  summary  can  only 
be  obtained  by  a  page  by  page  search  (if  legible)  since  the  information  is  available 
in  chronological  fashion.  Another  advantage  of  standardization  is  the  ability  to 
compare  data  in  patient  records.  As  a  tool  for  patient  management  and  preventive 
care,  this  system  can  identify  plan  members  who  meet  certain  medical  criteria. 
This  allows  physicians  the  capabihty  of  planning  and  initiating  action  for  patients 
who  appear  to  need  attention,  rather  than  waiting  for  them  to  present  themselves. 

ComparabiUty  allows  feedback  in  the  form  of  individual  and  aggregate  tables 
of  the  frequency  of  diagnoses  made,  tests  ordered,  and  medications  prescribed. 
These  tables  can  be  used  by  professional  staff  for  peer  review,  appropriateness  of 
care,  and  evaluation  of  costs. 

Restrictions  can  be  placed  on  standardization  of  data  in  terms  of  the  process 
of  data  gathering  of  the  content  of  the  record  itself.  Use  of  pre-structured  forms 
and  vocabulary  might  have  an  influence  on  the  physician  to  choose  one  of  the 
listed  items  when  an  unUsted  term  could  be  more  precise.  Efforts  have  been  made 
at  HCHP  to  minimize  the  problem  by  revising  encounter  forms  periodically  to 
reflect  these  patterns  and  physician  habits,  and  by  allowing  the  physician  to  write 
in  any  terms  which  do  not  appear  on  the  pre-coded  form,  and  by  allowing 
dictation  of  additional  comment  in  free  text  form.  In  addition,  the  medical 
content  of  the  present  computer  record  is  somewhat  limited  in  the  sense  that  it 
included  only  four  areas  of  data  on  each  encounter  (diagnoses,  tests,  therapy,  and 
disposition).  Whether  this  format  of  information  is  adequate  for  the  delivery  of 
care  depends  on  one's  perception  of  the  data  requirements.  This,  in  turn,  can  be 
affected  by  prior  experiences  and  the  policies  of  one's  own  work  environment. 

The  AMRS  medical  administrators  who  are  under  increasing  pressure  to 
make  more  rational  and  prospective  fiscal  decisions  must  have  the  tools  to 
recognize  trends  in  health  care  deUvery  which  have  a  direct  effect  on 
decision-making  and  developing  budgets.  With  this  system  information  is  available 
to  administrators  on  the  aggregate  medical  data  as  well  as  demographic  data.  In 
this  system,  any  data  item  may  be  used  as  an  index  for  a  table,  therefore,  its 
statistical  tables  or  reports  can  be  tailored  to  meet  the  needs  of  the  particular 
departments. 
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The  AMRS  performs  functions  which  are  distributed  among  a  number  of 
departments  and  traditional  medical  care  organizations.  The  conventional  medical 
record  room  is  responsible  for  only  the  handling  and  filing  of  the  medical  records, 
which  it  is  estimated  to  cost  from  25<l:  to  $1.75  per  visit,  depending  on  the  size 
and  nature  of  the  institution.  Traditionally,  the  medical  record  monitoring  for 
completeness  and  accuracy  is  performed,  by  the  clerical  staff,  while  fiscal  and 
utihzation  statistics  are  produced  by  the  accounting  department.  Cost  analyses  of 
these  services  are  not  available  from  traditional  settings  since  they  are  not 
considered  separate  functions.  The  cost  of  computer  processing  of  the  medical 
data  unique  to  this  system  are  estimated  at  60<l:  per  visit.  The  cost  effectiveness  of 
the  system's  distinct  capabilities  has  been  difficult  to  measure  due  to  inabilities  to 
measure  precisely  quaUty  and  quantity  of  care  and  the  value  of  its  outcome. 

C.  THE  NATIONAL  AMBULATORY  MEDICAL  CARE  SURVEY  (109,113) 

In  early  1967  the  National  Center  for  Health  Statistics  decided  to  conduct  a 
study  to  determine  the  feasibility  of  establishing  a  National  Ambulatory  Medical 
Care  Data  System.  Such  a  system  would  be  designed  to  provide  basic  national 
base  Ime  and  trend  data  for  planning,  legislation,  program  evaluation  and  research 
purposes.  The  feasibility  study  which  was  initiated  in  1967,  was  essentially 
completed  during  early  1972.  During  the  five  year  hfe  of  the  feasibility  study  the 
planning  group  (NCHS  staff,  consultants,  advisory  panel,  and  contractors) 
encountered  numerous  problems  and  tested  and  rejected  many  concepts, 
approaches,  and  procedures  before  arriving  at  the  National  Ambulatory  Medical 
Care  Survey  system  finally  accepted  for  implementation.  The  first  problem 
confronted  was  the  identification  of  the  universe  to  be  studied.  Should  the  unit  of 
measurement  be  the  ambulatory  patient;  the  physician  or  his  practice;  or  a  site 
such  as  outpatient  clinics,  emergency  rooms,  rehabilitation  or  day  care  centers,  or 
physicians'  offices?  Group  practices  and  HMO's  posed  special  problems.  It  was 
decided  that  the  office  based  practice  of  physicians  represented  a  major  segment 
of  ambulatory  medical  care  and  one  which  was  more  readily  identifiable  and 
measurable  than  other  alternative  units  of  measurement.  Consequently,  the 
universe  for  study  was  defined  as  all  non-federal  physicians  listed  in  the  AMA 
physician  master  file  for  the  coterminous  United  States  who  were  in  office  based 
practice  or  who  were  engaged  in  direct  patient  care.  It  was  recognized  that  data 
from  the  universe  defined  in  this  fashion  would  not  necessarily  be  additive  to  data 
from  other  systems  to  provide  a  total  characterization  of  all  ambulatory  care. 

The  next  issue  involved  was  identifying  and  evaluating  alternative  sources  of 
data  to  be  used.  Investigations  by  Lea,  Inc.  show  that  only  six  of  seven  physicians 
maintained  records  and  that  these  varied  considerably  in  their  accessibility  and 
completeness.  The  majority  of  physicians  would  not  accept  the  type  of  disruption 
of  their  office  procedures  which  a  transcription  from  their  records  would  require. 
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Nor  were  they  willing  to  supply  copies  of  their  office  records  even  with  patient 
identification  removed.  It  was  also  felt  that  direct  observations  of  physicians' 
office  traffic  by  an  enumerator  would  have  an  adverse  effect  on  the  patients  in 
the  office  waiting  for  care.  Consequently,  the  most  promising  approach  appeared 
to  be  a  current  sampling  scheme  where  information  would  be  recorded  on  a 
specially  designed  encounter  form  during  or  shortly  after  the  physician-patient 
contact. 

The  system  to  be  developed  would  have  to  maximize  the  data  collected, 
minimize  the  reporting  burden  on  the  physician,  and  minimize  the  logistical 
problems  and  cost  of  data  collection.  A  number  of  alternative  forms  and 
enumeration  procedures  were  tested  against  these  criteria,  and  three  separate  field 
tests  were  conducted  of  national  samples  ranging  from  700-900  physicians.  The 
results  of  these  tests  indicated  that  one  of  the  proposed  forms  was  probably  too 
long  and  represented  a  reporting  burden  on  the  physicians;  another,  while 
apparently  more  popular  with  the  physicians,  was  too  short  to  provide  enough 
basic  ambulatory  care  data;  a  third  form  tested  was  of  optimal  length  in  data 
requirements  and  reporting  time  and  was  therefore  accepted  for  the  survey.  Tests 
also  indicated  that  a  one  day  reporting  period,  while  a  minimum  burden  on  the 
physician,  would  cost  the  NCHS  too  much  for  amount  of  data  obtained,  whereas 
a  week  period  would  be  excessive  from  the  physicians  viewpoint.  A  two-day 
period  appeared  to  meet  the  needs  of  both  the  survey  and  the  responding 
physicians  and  therefore  was  adopted  as  the  basic  enumeration  period  for  the 
survey. 

The  planning  group  for  the  NAMCS  feasibility  study  recognized  from  the 
outset  that  an  adequate  response  rate  would  be  the  major  problem  in  developing  a 
National  Ambulatory  Medical  Care  Data  System.  This  conception  was  confirmed 
in  the  three  field  tests  conducted  during  the  feasibiUty  study.  Intensive 
consideration  was  given  to  various  alternatives  for  increasing  response  including 
paying  the  physician,  donating  to  his  choice  of  organization  or  medical  school, 
paying  his  office  help,  token  gifts  to  the  physician  or  his  staff,  feedback  to  the 
physician  of  statistical  data  on  his  peers  in  the  nation  and/or  his  own  practice,  and 
various  pubhc  relations  programs. 

Evidence  from  the  evaluation  questionnaire  used  in  the  study  field  trials  as 
well  as  from  other  surveys  such  as  the  National  Hospital  Discharge  Survey  indicate 
the  failure  to  pay  the  respondent  is  not  the  principal  deterrent  to  participation  in 
some  surveys;  however,  in  those  cases  where  it  is,  the  amount  that  would  have  to 
be  paid  to  participating  as  well  as  to  potentially  non-cooperating  physicians  would 
make  the  survey  financially  impossible  for  the  National  Center  for  Health 
Statistics.  The  evaluation  questionnaires  and  field  experience  clearly  indicated 
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that  the  single  most  important  factor  which  could  guarantee  a  successful 
ambulatory  care  data  system  was  a  favorable  attitude  toward  the  survey  by  the 
physician  universe  at  large  and  the  sample  physicians  in  particular. 

After  intensive  development  and  testing  of  alternative  concepts,  methods,  and 
procedures  during  the  five  year  period  of  feasibility  the  proposed  National 
Ambulatory  Care  Data  System  has  evolved.  The  system  will  be  initiated  on  a 
continuing  basis  at  the  beginning  of  the  calendar  year  1973  and  will  join  other 
surveys  of  health  statistics  in  the  National  Health  Survey  System.  The  data  from 
the  survey  will  be  processed  on  a  continuing  basis  to  produce  a  series  of  annual 
center-type  statistical  reports,  data  for  special  studies,  and  a  body  of  unpublished 
data  which  will  be  available  on  request.  Although  some  additional  planning  and 
details  are  being  developed  and  finalized,  it  is  now  anticipated  that  a  national 
sample  of  physicians  engaged  in  direct  patient  care  will  be  asked  to  submit 
completed  encounter  forms  for  ambulatory  patients  seen  during  two  sample  days 
in  each  of  the  four  consecutive  calendar  quarters. 

The  data  for  the  national  ambulatory  care  survey  will  come  from  three 
sources: 

•  encounter  form 

•  enlistment  questionnaire 

•  American  Medical  Association  and  American  Osteopathic  Association 
listings 

The  encounter  form  will  provide  episodic  data  on  the  age,  sex,  race,  marital 
status,  principal  complaint  and  diagnosis  of  the  patient;  diagnostic  procedures, 
duration  of  the  visit;  treatment;  and  case  disposition.  The  encounter  form  is  also 
used  in  pre-determining  the  sample  ratio  to  be  used  by  each  survey  physician.  The 
enlistment  form  is  designed  to  confirm  and  update  certain  background  informa- 
tion, before  the  patient  visit  reporting  period,  about  the  sample  physician  and  to 
obtain  additional  information  about  the  volume  and  nature  of  his  practice  and 
office  procedures.  The  latter  information  is  critical  in  determining  which  sample 
encounter  form  will  be  provided  the  physician  for  reporting  his  patient  visits. 
Physicians  with  small  practices  will  report  on  all  visits  during  the  period  of  days 
and  physicians  with  larger  practices  will  sample  visits  with  a  sample  interval 
directly  related  to  the  size  of  their  practice. 

Initiating  the  above  plan  during  the  calendar  year  1973  the  National  Center 
for  Health  Statistics  will  concentrate  its  resources  on  achieving  a  high  response 
rate  and  obtaining  high  quality  data.  This  will  necessitate  a  modest  start  of  about 
250  physicians  in  each  panel  with  a  total  sa,mple  of  some  1,000  physicians  by  the 
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third  quarter  of  1973.  If  in  later  years  the  survey  gains  greater  visibility  and 
acceptance  by  the  medical  world  and  if  the  National  Center  for  Health  Statistics 
gains  greater  experience  in  this  type  of  data  collection  effort,  the  sample  size  will 
be  increased  and  other  modifications  may  be  introduced  into  the  survey.  In  the 
future  it  may  be  possible  to  add  ad  hoc  supplementary  items  to  the  encounter 
form  and  to  conduct  special  studies  as  follow-ups  to  the  basic  survey. 
Longitudinal  studies  to  measure  the  courses  of  specific  diseases  identified  by  the 
National  Ambulatory  Medical  Care  Survey  may  also  be  possible.  The  data  may 
also  be  used  to  compare  local  ambulatory  practices  with  those  of  the  nation  as  a 
whole.  The  continuing  nature  of  the  survey  should  permit  observation  and 
measurement  of  trends  and  methods  of  treatment  and  the  course  of  selected 
epidemiological  conditions.  It  should  also  provide  valuable  information  for 
measuring  the  speed  and  effectiveness  with  which  advances  in  medical  practice, 
technology,  and  pharmacology  become  introduced  into  a  basic  segment  of 
medical  care;  the  physician's  practice.  The  survey  results  will  be  used  to  suggest 
further  studies  and  provide  base  line  data. 

D.  BASIC  AMBULATORY  DATA  SET  (275) 

During  April,  1972,  an  intensive  five  day  working  conference  was  held  in 
Chicago  on  ambulatory  medical  care  records  and  was  sponsored  by  the  National 
Center  for  Health  Statistics,  the  National  Center  for  Health  Services  Research  and 
Development,  and  the  Johns  Hopkins  University.  Leading  representatives  of  the 
major  parties  concerned  with  the  collection  and  use  of  ambulatory  medical  care 
data  were  present  at  the  conference.  Participants  included  members  of  the 
American  Medical  Association,  the  American  Hospital  Association,  the  National 
Medical  Association,  medical  specialty  groups,  representatives  of  the  Health 
Services  and  Mental  Health  Administration,  representatives  of  the  Social  Security 
Administration,  directors  of  regional,  state  and  local  health  information  systems, 
experts  in  epidemiological  and  health  services  research,  and  individuals  with 
experience  in  ambulatory  care  records  from  Canada  and  the  United  Kingdom. 
This  conference,  which  was  similar  to  the  previously  described  conference  held  at 
Airlie  House  in  June,  1969,  examined  the  component  of  ambulatory  medical  care 
records  with  the  purpose  of  identifying  the  basic  requirements  for  information 
about  this  equally  important  component  of  medical  care  and  to  propose  measures 
for  meeting  these  requirements. 

The  conference  participants  were  fully  cognizant  about  the  requirements  and 
opportunity  for  improving  basic  information  about  ambulatory  care.  With  the 
increasing  emphasis  on  ambulatory  services  as  a  more  suitable  and  less  expensive 
modality  of  care  for  many  health  problems,  the  conference  participants  postulated 
that  better  data  are  essential  for  at  least  eight  functions: 
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•  To  assist  physicians  in  caring  for  patients  and  managing  practice 

•  To  facilitate  self  evaluation  by  peer  review 

•  To  provide  the  medical  profession  with  a  better  understanding  of  the 
natural  history  of  health  problems,  complaints  and  diseases 

•  To  assist  those  responsible  for  the  management  of  group  practice  and 
ambulatory  health  systems,  in  planning  services  and  in  allocating 
personnel  and  other  resources,  and  in  monitoring  costs. 

•  To  assist  medical  educators  in  clarifying  the  objectives  of  curricula  for 
medical  personnel  and  health  services  administrators 

•  To  support  the  efforts  of  local,  state,  and  national  agencies  in 
formulating  objectives,  plans,  and  policies  for  improving  health  services 

•  To  serve  needs  of  private  and  public  insurance  carriers,  Blue  Cross  and 
Blue  Shield,  Social  Security  Administration,  and  related  federal 
payment  programs  and  to  permit  the  development  of  uniform  health 
insurance  claims  forms  and  patient  billing  forms 

•  To  provide  epidemiologists  and  other  health  research  investigators  with 
sampHng  frames  for  research  designed  to  improve  the  impact  of  health 
services 

The  conference  set  forth  that  the  first  and  most  important  steps  are  to 
identify  the  basic  core  of  data  germane  to  these  functions  and  to  introduce 
uniform  terms,  definitions,  and  classifications  for  this  data  set.  The  major  concern 
of  the  conference  was  the  proUferation  of  different  ambulatory  medical  record 
information  systems  being  introduced  by  federally  sponsored  health  programs,  by 
medical  foundations  and  institutions,  and  by  commercial  data  processing 
companies.  The  conference  participants  proposed  that  a  minimum  uniform  basic 
data  set  form  a  part  of  each  patient's  medical  record  to  facilitate  universal 
availability  for  abstracting,  reporting,  and  analysis. 

The  participants  proposed  the  following  list  as  a  minimum  basic  data  set  to 
be  incorporated  in  the  medical  record: 

•  Registration  data 

—  patient  identification 

—  residence  (including  zip  code) 

—  date  of  birth 
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—  sex 

—  marital  status 

—  race 

•  Encounter  data 

—  facility  identification 

—  provider  identification 

—  patient  identification 

—  source(s)  of  payment 

—  date 

—  patient's  purpose,  reason,  symptom  or  complaint 

—  physician's  diagnosis  of  problem  designation 

—  diagnostic,  therapeutic  or  management  procedures 

—  disposition  of  patient 

It  was  emphasized  that  the  above  mentioned  list  is  not  a  substitute  for  a 
reporting  system  or  a  more  extensive  clinical  record.  It  was  described  as  the 
irreducible  minimum  of  data  required  for  the  eight  listed  functions  and  the  data 
set  most  in  need  of  common  definition  at  this  time.  It  was  recognized  that  this 
basic  data  set  would  be  necessary  but  rarely  sufficient  for  most  purposes. 

The  conference  participants  felt  that  each  term  needs  to  be  defined 
specifically,  and  methods  of  classifying  and  coding  the  information  agreed  upon. 
Where  suitable,  the  terms,  definitions,  and  classifications  should  be  identical,  or  at 
least  compatible,  with  those  that  comprise  the  recently  developed  Uniform 
Hospital  Discharge  Data  Set.  They  should  be  related  to  domestic  and  international 
terminology  and  classification,  such  as  the  ICDA-8,  Current  Medical  Terminology, 
the  glossary  published  by  the  American  Record  Association,  and  the  various 
classifications  for  procedures.  Classifications  should  also  be  developed  for: 

•  Types  of  provider  settings,  facilities  and  organizations 

•  Types  of  health  care  providers  and  personnel 

•  Reasons  or  purposes  for  using  ambulatory  medical  care 

•  Symptoms,  complaints,  conditions  or  health  problems 

•  Procedures  and  services 
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Wherever  feasible,  pre-coded  classifications  and  reporting  methods  should  be 
encouraged.  Problems  of  reliability,  vahdity,  and  utility  of  terms,  classifications 
and  data  elements  should  be  examined  initially  and  subjected  to  continuing 
methodologic  and  evaluative  research.  Particular  attention  should  be  paid  to  the 
problems  of  making  usable  information  promptly  available  to  physicians  and 
administrators  in  a  basic  data  set  in  order  that  they  may  assess  its  value  in  the  care 
of  patients  and  in  the  management  of  practices,  health  care  organizations  and 
institutions. 

VI.  SUMMARY  OF  CONFERENCE  PROCEEDINGS  ON  HOSPITAL 
AND  AMBULATORY  CARE  DATA 

A.  HOSPITAL  DISCHARGE  ABSTRACT  SYSTEMS  (180) 

The  Airlie  House  Conference  on  Hospital  Discharge  Abstract  Systems  put 
forth  a  series  of  major  recommendations.  The  Conference  agreed  that  hospital 
discharge  abstract  systems  were  essential  for  at  least  six  functions.  They  were: 

( 1 )  To  provide  data  for  periodic  review  of  patient  management  patterns 

(2)  To  provide  data  for  efficient  and  economical  hospital  management 

(3)  To  relate  charges  for  hospitalization  to  diagnostic  and  individual  patient 
information 

(4)  To  provide  data  for  community  and  regional  health  planning  bodies 

(5)  To  provide  data  for  health  services  and  epidemiological  research 

(6)  To  provide  common  insurance  claims  forms  for  use  by  private  insurance 
carriers,  Blue  Cross,  and  the  Social  Security  Administration 

The  participants  of  the  Conference  who  represented  the  major  users  and 
operators  of  hospital  discharge  abstract  data  believed  that  a  minimum  basic  data 
set  for  inclusion  in  hospital  discharge  abstract  systems  could  be  identified  and 
that  the  routine  collection  of  this  data  set  in  a  uniform  manner  was  feasible.  The 
major  concerns  motivating  the  participants  to  seek  the  uniform  basic  data  set 
were  the  rising  costs  of  care,  persistent  maldistribution  of  services,  increasing 
impact  of  the  hospital  on  both  health  services  and  health  status  of  the  total 
community,  and  the  changing  role  of  the  hospital  and  community  health  service. 
The  major  recommendations  of  the  conference  were: 
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Recommendation  A 


The  Conference  recommended  that  the  inclusion  of  the  following  elements 
in  a  minimum  basic  data  set  and  that  all  short-term  general  hospitals  should 
collect  these  on  all  discharges. 

•  Patient  identification 

•  Date  of  birth 

•  Sex 

•  Social  characteristics 

•  Resident's  identification  for  conversion  to  census  tract 

•  Hospital  identification 

•  Physician  identification 

•  Source  of  referral 

•  Admission  and  discharge  dates 

•  Service  to  which  patient  is  admitted 

•  Diagnoses 

•  Surgical  procedures 

•  Disposition  (if  death,  was  autopsy  performed) 

•  Payment  sources 

•  Charges 

Each  term  would  be  defined  specifically,  and  methods  of  classifying  and 
coding  the  information  agreed  upon.  The  terms  need  to  be  related  to  such 
classification  schemes  as  the  ICDA-8,  Current  Medical  Terminology,  and  the 
glossary  published  by  the  American  Association  of  Medical  Records  Librarians. 
The  problems  concerning  the  reUability  and  vaUdity  of  the  data  would  also  need 
serious  consideration. 
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The  Conference  also  believed  that  all  existing  systems,  with  relatively  minor 
modifications,  have  the  capabihty  to  produce  this  minimum  uniform  basic  data 
set.  Existing  national  and  regional  systems  would  need  to  be  encouraged  to 
request  these  data  from  all  participating  hospitals.  It  was  stipulated  that  this 
recommendation  should  not  be  interpreted  as  Hmiting  the  amount  of  supple- 
mental information  collected  and  processed  the  data  systems  or  individual 
hospitals. 

The  recommendation  to  include  place  of  residence  information  would 
permit  referral  of  all  information  collected  to  population  denominators  based  on 
census  tract  aggregations. 

In  an  effort  to  implement  these  recommendations,  the  conference  proposed 
that  a  continuing  group,  with  representatives  from  all  interested  parties,  be  set  up 
to  deal  with  the  technical  problems  and  terms,  definitions,  classifications,  codes, 
maintenance  of  rehability,  and  requirements  for  legitimization.  The  participants 
felt  that  the  Department  of  Health,  Education,  and  Welfare  would  be  the  most 
appropriate  and  effective  agency  to  sponsor  such  a  group  and  recommended  that 
a  subcommittee  of  the  National  Committee  on  Vital  and  Health  Statistics  be  set 
up  for  this  purpose.  This  subcommittee  and  the  contracts  awarded  to  the  Health 
Research  and  Education  Trust  and  Health  Services  Foundation  were  previously 
discussed. 

Recommendation  B 

The  Conference  recommended  the  support  of  research  and  development  in 
the  following  areas  where  major  unresolved  conceptual  technical  problems  still 
remained: 

(1)  Confidentiality  of  information  on  patients,  physicians  and  hospitals. 
Participants  considered  this  issue  to  be  of  major  importance  and  in  need 
of  further  exploration. 

(2)  The  generation  of  information  on  the  use  of  services  in  hospital 
outpatient  departments,  physicians  offices,  extended  care  facilities,  and 
special  hospitals. 

(3)  The  development  of  social  indicators  and  indicators  of  functional  status 
of  patients,  which  would  be  included  on  the  basic  data  set,  once 
perfected. 

(4)  A  systems  approach  to  providing  information  to  multiple  users  by 
means  of  single  instruments  (e.g.,  summary  of  face  sheets,  names,  forms 
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and  discharge  abstracts)  thereby  reducing  paper  work.  This  technique 
also  generates  the  basic  data  for  machine  preparation  of  diagnostic  and 
patient  indexes. 

(5)  Linkage  of  records  of  health  related  events,  was  considered  highly 
desirable.  In  anticipation  of  record  linkage,  positive  patient  identifica- 
tion would  need  to  be  ultimately  included  in  the  patient  data  set.  The 
Conference  recommended  that  techniques  for  record  linkage  receive 
research  and  development  support. 

(6)  The  Conference  stressed  more  effective  coordination  between  the 
National  Hospital  Discharge  Survey  and  existing  systems.  The  National 
Center  for  Health  Statistics  indicated  that  it  was  prepared  to  experi- 
ment with  the  collection  and  processing  of  data  obtained  from  hospital 
discharge  systems  when  hospitals  falling  with  the  HDS  sample  are 
participating  in  the  systems. 

(7)  The  Conference  recommended  that  the  National  Center  for  Health 
Services  Research  and  Development  participate  actively  in  the  solutions 
of  these  problems.  This  would  allow  the  establishment  of  experimental 
regional  health  data  clearinghouses  where  these  problems  could  be 
studied. 

Recommendation  C 

The  Conference  strongly  recommended  that  the  recommendation  and 
background  papers  of  the  sessions  be  pubhshed  and  widely  disseminated.  This  has 
been  accomplished  ( 1 80). 

B.  BASIC  AMBULATORY  DATA  SET  (275) 

The  participants  in  the  Conference  on  minimum  basic  data  set  for 
ambulatory  care  also  produced  three  sets  of  recommendations  which  parallel 
those  set  forth  at  the  Airlie  House  Conference  on  Hospital  Discharge  Data.  The 
three  sets  of  recommendations  were  as  follows. 

Recommendation  A 

A  continuing  group,  with  wide  representation  from  interested  parties,  should 
be  established  promptly  to  determine  the  content,  terms,  definitions,  classifica- 
tions schemes  and  codes  to  be  employed  in  the  Basic  Ambulatory  Data  Set.  This 
group  should  review  the  basic  data  set  periodically  and  revise  it  on  the  basis  of 
experience.  The  participants  believed  that  the  Department  of  Health,  Education  & 
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Welfare  was  the  most  appropriate  and  effective  agency  to  sponsor  such  a  group, 
and  recommended  that  a  sub-committee  and  one  or  more  task  forces  of  the 
National  Committee  on  Vital  and  Health  Statistics  be  designated  as  responsible 
for  these  purposes. 

Research  and  development  in  areas  where  major  unresolved  conceptual  or 
technical  problems  remain  should  be  undertaken.  Among  these  are: 

(1)  Positive  patient  identification  within  and  between  health  care  sources, 
systems  and  regions  is  of  major  importance  and  needs  further 
exploration.  The  patient  identification  number  was  considered  to  be 
the  key  to  linking  events  in  the  medical  management  of  the  individual 
patient,  to  incorporation  of  ambulatory  data  with  inpatient  data  and 
the  patient  profile,  and  to  an  understanding  of  individual  and 
community  patterns  of  medical  care. 

(2)  The  uses  of  information  generated  from  records  incorporating  the 
minimum  basic  data  set  needs  critical  examination.  Methods  for 
aggregating,  tabulating,  analyzing  and  displaying  information  should  be 
subjected  to  periodic  revision  in  order  that  they  can  be  usefully  applied 
to  all  points  of  the  health  care  system. 

(3)  Testing  of  the  minimum  basic  data  set  should  be  undertaken  in  several 
kinds  of  settings  such  as  direct  federal  health  services  programs; 
federally  funded  health  services  organizations;  cooperative  federal, 
state,  local  health  services  data  systems;  medical  societies  and  founda- 
tions; and  circumscribed  geographic  regions  where  all  or  most  of  the 
physicians  agree  to  participate;  prepaid  group  practices;  hospital-based 
ambulatory  services;  university-sponsored  health  care  organizations;  and 
practices  of  members  belonging  to  medical  associations  or  specialty 
groups. 

(4)  Operations  research  and  demonstration  projects  are  needed  to  experi- 
ment with  methods  and  organizational  frameworks  for  capturing, 
tabulating,  aggregating  and  assimilating  information  on  ambulatory 
medical  care  at  the  local,  state,  and  regional  levels. 

(5)  Incorporation  of  the  minimum  basic  data  set  into  record-keeping 
reporting,  monitoring  and  payment  systems  should  be  undertaken  as 
part  of  the  contingency  planning  for  the  prospect  of  some  form  of 
national  health  insurance  or  other  form  of  generalized  third-party 
payment  scheme. 
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(6)  Skilled  manpower  should  be  trained  to  conceptualize,  design,  and 
operate  statistical  and  information  systems  at  federal,  state,  local, 
organizational  institutional  levels. 

(7)  Development  of  measures  including  indexes  and  profiles  of  the 
functional  status  of  patients  should  be  encouraged.  Measures  of 
urgency,  severity,  rate  of  progression,  duration  of  illness,  and  of 
expected  outcome  require  creation,  testing,  and  evaluation  for  applica- 
tion to  individual  patients  and  populations. 

(8)  Forms  and  arrangements  for  data  collection  should  be  developed,  tested 
and  evaluated,  so  that  minimal  writing  will  be  required  of  the  physician 
and  maximum  use  will  be  made  of  the  data. 

Recommendation  B 

The  Conference  recommended  that  as  soon  as  the  precise  content,  terms, 
standards,  uses  and  feasibility  of  the  minimum  uniform  basic  data  set  have  been 
established,  it  be  widely  promoted  and  adopted  by  all  parties  concerned  with  the 
ambulatory  medical  care. 

The  minimum  uniform  basic  data  set  should  be  required  as  part  of  the  basic 
medical  record,  and  abstracted  as  appropriate  by: 

•  Federally  funded  health  services  and  health  insurance  programs 

•  Cooperative  federal  —  state  —  local  health  services  data  systems 

•  Private  insurance  carriers;  Blue  Cross  and  Blue  Shield;  accrediting, 
certification  and  licensing  groups  and  agencies;  professional  review 
organizations 

The  National  Ambulatory  Medical  Care  Survey  (previously  described)  and  all 
related  federal,  state,  and  local  surveys  should  incorporate  the  minimum  basic 
data  set,  with  the  exception  of  patient  identification  in  their  collection 
procedures. 

Recommendation  C 

The  Conference  recommended  that  the  appropriate  background  papers  and 
discussions  of  the  conference  be  pubhshed  promptly  and  distributed  widely.  The 
proceedings  of  this  Conference  will  be  pubhshed  shortly  (275). 
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APPENDIX  A 

RESTATEMENT  OF  THE  BENNETT  AMENDMENT  (P.L.92-603) 


The  purpose  of  P.L.92-603  is  to  promote  the  effective,  efficient,  and 
economical  delivery  of  Medicare  and  Medicaid  health  services  through  the 
appUcation  of  professional  standards  review  procedures.  The  provision  is  designed 
to  assure  proper  utilization  of  care  and  services  through  a  formal  professional 
mechanism  representing  the  broadest  possible  cross-section  of  practicing  physi- 
cians in  an  area.  The  review  would  assure,  within  recognized  professional  health 
care  standards,  that  medical  services  financed  under  the  Social  Security  Act  are: 

•  Of  appropriate  quality, 

•  Provided  only  when  necessary,  and 

•  Provided  in  the  most  economical  fashion. 

Professional  Standards  Review  Organizations 

The  Secretary  will  establish  appropriate  areas  throughout  the  country  by 
January  1,  1974,  and  at  the  earliest  practicable  date,  designate  a  qualified 
organization  as  the  PSRO  for  each  area. 

A  qualified  organization  will  be  a  nonprofit  professional  association,  with 
voluntary  membership,  including  a  substantial  number  of  the  practicing  physi- 
cians in  the  area  (generally  stated  at  300  or  more).  Membership  in  the  PSRO  and 
service  for  the  PSRO  cannot  be  constrained  by  a  requirement  for  membership  in 
or  payment  of  dues  to  a  medical  society.  The  qualified  organization  must 
demonstrate  its  professional  competence  to  review  health  care  services  in  a  formal 
plan  submitted  to  the  Secretary. 

Until  January  1,  1976,  the  Secretary  will  be  able  to  make  such  agreements 
only  with  a  qualified  organization  which  represents  a  substantial  proportion  of  the 
physicians  in  the  geographical  area  designated.  Until  January  1,  1976,  at  the 
request  of  1 0  percent  or  more  of  the  practicing  physicians  in  a  geographical  area 
designated  by  the  Secretary,  the  Secretary  will  be  required  to  poll  the  practicing 
physicians  in  the  area  as  to  whether  or  not  an  organization  of  physicians  which 
has  requested  to  conclude  an  agreement  with  the  Secretary  to  establish  a  PSRO 
substantially  represents  the  practicing  physicians  in  that  area.  If  more  than  50 
percent  of  the  practicing  physicians  in  the  area  responding  to  the  poll  indicate 
that  the  organization  does  not  substantially  represent  the  practicing  physicians  in 
the  area,  the  Secretary  will  not  enter  into  an  agreement  with  that  organization. 
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After  January  1,  1976,  in  any  area  where  such  a  professional  organization  is 
unwilling  or  unable  to  meet  these  conditions,  the  Secretary  may  designate  any 
public,  nonprofit  private,  or  other  agency  or  organization  as  the  PSRO  providing 
that: 

•  The  final  determinations  of  peer  review  are  made  by  physicians,  and 

•  That  the  agreement  will  not  be  renewed  if  a  qualified  professional 
organization  is  willing  and  able  to  become  the  PSRO  for  the  area. 

Each  PSRO  will  review  the  utihzation  and  quality  of  all  institutionally 
provided  services  in  the  designated  area.  The  PSRO  will  not  be  involved  with  the 
determination  of  reasonable  charges.  With  the  concurrence  of  the  Secretary,  the 
PSRO  may  also  review  other  than  institutional  services.  These  reviews  will 
determine  that: 

•  The  services  and  items  are  or  were  medically  necessary, 

•  The  quahty  of  the  services  meet  professionally  recognized  standards  of 
health  care,  and 

•  The  services  are  or  were  provided  at  the  most  economical  level  of  care 
appropriate  to  the  need  (i.e.,  outpatient,  extended  care,  hospital,  etc.). 

To  accomplish  these  purposes,  the  PSRO  will  utilize  and  apply  regional 
norms  of  care  and  treatment,  based  upon  typical  patterns  of  practice  in  the 
region,  prepared  and  revised  by  the  National  Council.  Norms  will  be  developed  in 
accordance  with  the  regulations  of  the  Secretary  and  will  include: 

•  The  type  and  extent  of  service  within  the  range  of  appropriate 
treatment  for  each  illness  or  health  condition,  and 

•  The  type  of  health  care  facility  which  can  most  economically  provide 
appropriate  medical  services  for  each  illness  or  health  condition. 

Each  PSRO  will  utilize  the  norms  described  above  as  the  standards  for 
evaluation  and  will  perform  the  following  functions: 

(1)  Prospective  determination  of  the  medical  necessity  and  appropriateness 
for  elective  admissions  and  extended  or  costly  courses  of  treatment. 

(2)  Periodic  determination  and  pubUcation  of  selected  types  and  kinds  of 
cases  (by  service,  diagnosis,  or  other  criteria)  for  intensive  and  more 
effective  review. 
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(3)  Regular  review  of  profiles  of  care  for  selected  patient  groups, 
practitioners,  and  other  providers  of  service. 

(4)  Time  specification  for  the  certification  of  continuing  inpatient  care  not 
later  than  the  regional  norm  for  the  50th  percentile  of  length  of  stay 
for  patients  in  similar  age  groups  with  similar  diagnoses. 

(5)  Require  physician  certification,  and  supporting  justification  for  con- 
tinued inpatient  care  beyond  these  specified  points  in  time. 

(6)  Foster  the  acceptance  of  PSRO  functions  by  broad  physician  participa- 
tion, rotating  membership  on  review  committees,  wide  specialty 
representation,  and  publication  of  PSRO  activities  in  appropriate 
professional  pubUcation. 

(7)  Report  any  violations  of  the  obligations  of  a  practitioner,  hospital,  or 
other  health  care  facility,  agency,  or  organization,  under  this  Program, 
to  the  State  Council  including  any  pertinent  recommendations. 

(8)  Notify  any  practitioner  or  provider,  and  provide  opportunity  for 
discussion  and  review,  when  any  determination  denies  a  request  for 
services  or  identifies  a  violation  of  any  obligation  by  the  practitioners 
or  provider. 

(9)  Notify  the  pertinent  intermediary  of  any  disapproved  services  or  items. 

Physicians  assigned  the  responsibility  for  hospital  review  should  have 
hospital  privileges  in  at  least  one  of  the  participating  hospitals  in  the  area  and 
should  not  be  responsible  for,  but  may  participate  in,  the  review  of  services  in 
their  own  hospital.  No  physician  will  review  services  in  which  he  was  directly  or 
indirectly  involved  or  services  provided  by  any  institution,  organization,  or  agency 
in  which  he  or  his  family  have  a  vested  interest. 

After  notification,  any  beneficiary  or  recipient  who  is  dissatisfied  with  a 
decision  made  with  regard  to  his  claim,  will  be  entitled  to  a  reconsideration  by  the 
PSRO.  This  decision  may  be  appealed  to  the  State  Council,  if  the  determination 
mvolves  more  than  $100.  Where  the  decision  of  the  State  Council  is  adverse,  or  in 
the  absence  of  a  State  Council,  a  beneficiary  will  be  entitled  to  a  hearing  by  the 
Secretary  in  any  controversy  involving  more  than  $100  and  to  judicial  review  of 
the  Secretary's  decision  if  the  controversy  involves  more  than  $1,000. 
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After  notification  of  an  adverse  decision  by  the  PSRO,  a  practitioner  or 
provider  will  have  an  opportunity  for  further  discussion  and  review  by  the  PSRO. 
The  final  recommendations  of  the  PSRO  are  referred  to  the  State  Council  and 
then  to  the  Secretary  who  may  apply  authorized  sanctions.  Any  provider  who  is 
dissatisfied  with  an  adverse  decision  made  by  the  Secretary,  involving  exclusion 
from  the  Program  or  requiring  repayment,  is  entitled  to  a  hearing  by  the  Secretary 
and  to  judicial  review  of  the  Secretary's  final  decision. 

State  Councils 

In  any  State  with  three  or  more  PSRO's,  the  Secretary  will  establish  and 
appoint  the  membership  of  a  State  Council  which  will  include: 

•  One  representative  designated  by  each  PSRO. 

•  Four  physicians  (two  designated  by  the  State  medical  society  and  two 
designated  by  the  State  hospital  association). 

•  Four  knowledgeable  pubUc  representatives  (two  recommended  by  the 
Governor  of  the  State). 

Each  State  Council,  and  the  PSRO's  in  states  without  a  Council,  will  have  an 
Advisory  Group  of  seven  to  eleven  members  including  representatives  of  health 
care  practitioners,  other  than  physicians,  and  hospitals  and  other  facilities  which 
provide  Medicare  and  Medicaid  services  in  the  State.  The  Secretary  will  provide 
regulations  to  determine  the  manner  in  which  the  Advisory  Group  is  selected. 

The  State  Councils,  where  estabUshed,  will: 

•  Review,  comment  upon,  and  transmit  to  the  Secretary  any  reports, 
received  from  the  PSRO's  concerning  violations  of  the  Program. 

•  Review  any  appeals  to  a  PSRO  decision  involving  more  than  $  100. 

•  Coordinate  the  activities  of,  and  disseminate  information  and  data 
among,  the  various  PSRO's  in  the  State. 

•  Assist  the  Secretary  in  developing  uniform  data  gathering  procedures  to 
insure  efficiency  and  objective  comparison. 

•  Assist  the  Secretary  in  the  evaluation  of  each  PSRO. 

•  Assist  the  Secretary  in  developing  and  arranging  for  a  qualified  PSRO 
replacement,  when  necessary. 
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National  Council 


A  National  Professional  Standards  Review  Council  of  eleven  physicians  will 
be  appointed  by  the  Secretary  for  three  year  terms  with  eligibility  for 
reappointment.  The  Secretary  will  designate  one  of  the  members  to  serve  as 
Chairman.  A  majority  of  the  Council  will  be  recommended  by  national 
organizations  representing  physicians,  but  the  Council  will  include  physicians 
recommended  by  consumer  groups  and  other  health  care  interests.  All  members 
will  be  physicians  of  recognized  standing  and  distinction  in  the  appraisal  of 
medical  practice. 

The  National  Professional  Standards  Review  Council  will: 

•  Advise  and  assist  the  Secretary  in  the  administration  of  the  program. 

•  Prepare  and  distribute  regional  "norms,"  with  periodic  revisions,  based 
on  a  review  of  appropriate  and  adequate  data. 

•  Provide  technical  assistance  in  the  utilization  of  such  norms  of  care  and 
treatment. 

•  Review   the  comparative  performance  and  effectiveness  of  State 
Council's  and  PSRO's. 

•  Recommend  measures  to  improve  the  Program. 

•  Submit  an  annual  report  to  the  Secretary  and  to  the  Congress. 

Authorizations  to  Strengthen  the  PSRO 

To  the  extent  necessary  or  appropriate  for  the  proper  performance  of  its 
duties  and  functions,  the  PSRO  serving  any  area  is  authorized,  in  accordance  with 
regulations  prescribed  by  the  Secretary,  to: 

(1)  Make  arrangements  to  utilize  the  services  of  practitioners  or  specialists 
to  conduct  the  necessary  review. 

(2)  Undertake  professional  inquiry  before  or  after,  or  both  before  and 
after,  the  provision  of  any  service. 

(3)  Examine  the  pertinent  records  of  any  practitioner  or  provider. 

(4)  Inspect  the  physical  facilities  in  which  care  is  rendered. 


336 


Arthur  D  Little;  Inc 


(5)  Utilize  the  services,  and  accept  the  findings  of  area  hospital  review 
committees  with  demonstrated  competence. 

(6)  Utilize  the  services  of  medical  societies  and  similar  organizations  to 
assist  in  one  or  more  of  the  review  activities,  when  they  have 
demonstrated  their  capacity  to  effectively  perform  these  functions  in  a 
timely  fashion. 

After  proper  notification,  no  Medicare  or  Medicaid  claim  will  be  paid  if  the 
service  or  item  in  question  is  subject  to  review  by  a  PSRO,  and  has  been 
disapproved  by  the  PSRO. 

The  legislation  specifically  obligates  each  health  care  practitioner  and 
provider,  to  the  extent  of  their  influence  or  control,  to  provide  services: 

•  Only  when  and  to  the  extent  that  they  are  medically  necessary, 

•  Of  a  quaUty  which  meets  professionally  recognized  standards  of  health 
care,  and 

•  At  the  most  economic  level  of  service. 

Failure  to  comply  with  these  obligations,  in  a  substantial  number  of  cases,  or 
one  or  more  gross  and  flagrant  violations  of  these  obligations  may  lead  to: 

•  Exclusion  from  eligibility  for  reimbursement  under  Medicare  and 
Medicaid  on  a  permanent  basis  or  for  a  stated  period  of  time,  or 

•  A  requirement  for  repayment  of  the  improper  service  or  $5,000 
whichever  is  less. 

Both  sanctions  would  be  applied  only  after  proper  application  of  the  appeals 
mechanism,  described  earlier,  and  exclusion  from  eligibility  for  payment  would 
become  effective  only  after  notification  to  the  public. 

The  provisions  of  this  Amendment  apply  to  the  operation  of  any  State  plan 
approved  under  the  Social  Security  Act  as  a  Medicare  or  Medicaid  health  care 
program. 

All  data  and  information  acquired  by  a  PSRO  is  confidential  and  will  only  be 
disclosed  on  a  need-to-know  basis  or  as  provided  by  the  Secretary  in  regulations. 
Illegal  disclosure  may  result  in  a  fine  of  not  more  than  $  1 ,000  and  imprisonment 
of  not  more  than  six  months,  or  both. 
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Limitations  on  liability  are  provided  by  the  legislation  for  activities  in 
relation  to  a  PSRO.  Notwithstanding  any  other  provision  of  law: 

•  No  person  will  be  liable  for  the  provision  of  relevant  information  which 
he  believes  to  be  true,  to  a  PSRO. 

•  In  the  absence  of  mahce,  no  person  is  liable  for  the  performance  of  his 
duties  as  an  employee  or  agent  of  a  PSRO. 

•  No  practitioner  or  provider  is  liable  for  actions  in  his  normal  work, 
taken  with  due  care,  in  compliance  with  the  accepted  norms  of  care  and 
treatment  applied  by  a  PSRO  in  his  area. 

Implementation  of  the  Program 

The  Secretary  will  establish  appropriate  areas  for  PSRO's,  throughout  the 
United  States,  not  later  than  January  1,  1974  and  designate  qualified  organiza- 
tions as  PSRO's  at  the  earliest  practicable  date  thereafter. 

Pending  assumption  of  responsibiUty,  and  demonstration  of  capacity  for 
improved  audit,  current  activities  will  be  continued. 

The  Secretary  will  review  and  approve  a  formal  plan  for  progressive 
assumption  of  full  responsibiUty  and  initially  designate  an  organization  as  a  PSRO 
on  a  conditional  basis.  During  the  trial  period  (not  to  exceed  24  months)  the 
Secretary  may  require  the  PSRO  to  perform  only  Umited  duties  and  functions. 
Assumption  of  responsibility  for  duties  should  proceed  in  accordance  with  the 
approved  plan,  so  that  at  the  end  of  the  trial  period,  the  PSRO  is  performing  all 
required  duties  and  functions. 

Conditional  PSRO  agreements  may  be  terminated  by  either  party  on  90 
days'  notice. 

Any  duties  and  functions  not  performed  by  a  PSRO,  during  a  trial  period, 
will  continue  to  be  performed  as  presently  authorized.  The  Secretary  is 
authorized  to  waive  any  other  review  requirements  when  substantial  evidence 
indicates  that  the  PSRO  meets  or  exceeds  those  requirements. 

The  Secretary  will  provide  regulations  for  correlation  and  cooperation 
between  carriers,  intermediaries,  government  agencies  and  PSRO's  which  include 
the  usage  of  existing  data  gathering  capacity  where  appropriate. 
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The  Secretary  is  authorized  to  provide  all  necessary  technical  assistance  to 
appropriate  organizations  in  developing  a  plan  for  designation  as  PSRO's. 

Expenses  incurred  in  the  administration  of  this  Amendment  are  payable 
from  the  Hospital  Insurance  Trust  Fund,  the  Supplementary  Medical  Trust  Fund, 
and  funds  appropriated  for  other  titles  of  the  Social  Security  Act  in  such 
proportion  as  the  Secretary  deems  to  be  equitable.  These  expenses  may  include: 

•  Technical,  consultative,  secretarial  and  clerical  services,  and  compensa- 
tion for  the  National  Council. 

•  Reasonable  and  necessary  expenses  for  the  State  Councils,  including  the 
cost  of  the  Advisory  Groups. 

•  Reasonable  and  necessary  expenses  for  the  operation  of  the  PSRO's. 

•  The  expenses  of  technical  support  services  to  help  develop  PSRO's. 
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APPENDIX  B 


GLOSSARY  OF  SELECTED  TERMS 

We  have  included  this  glossary  of  selected  terms  because  of  evident 
confusion  concerning  their  use  in  medical  care  appraisal.  The  most  common 
meaning  for  each  term  has  been  given.  While  this  usage  may  not  agree  with  all 
other  reports,  it  will  at  least  provide  a  common  language  for  the  intepretation  and 
discussion  of  this  paper. 

Structural  Appraisal  —  evaluation  of  the  preparation  of  an  individual  professional 
or  the  adequacy  of  a  facility  or  organization  to  provide  specific  health  services  at 
a  stated  level  of  quality.  Structural  appraisal  often  includes  licensure  and/ or 
certification. 

Process  Appraisal  —  evaluation  of  health  services  actually  provided  to  patients  or 
the  operation  of  institutional  mechanisms  designed  to  effect  health  services. 

Outcome  Appraisal  —  evaluation  of  the  results  or  consequences  of  disease  or 
medical  intervention.  Outcomes  may  be  either  intermediate  or  final.  Outcomes 
with  regard  to  individual  patients  or  population  groups  may  be  subclassified  as: 

Patient  Outcomes  such  as  mortahty  or  survival,  physical  or  psychological 
morbidity,  and  the  level  of  function; 

Process  Outcomes  including  patient  satisfaction,  understanding  of  disease, 
compUance  with  medical  regimens,  and  altered  level  of  risk; 

Administrative  Outcomes  including  the  utihzation  of  services,  work  loads, 
waiting  time  intervals,  and  other  volumetric,  measures  of  managerial  interest; 

Economic  Outcomes  specifying  the  costs  generated  by  services  provided. 

Criteria  —  specified  elements  of  medical  care  considered  appropriate  or  relevant  to 
each  diagnosis  or  condition. 

Norms  -  empiric  measures  of  performance  such  as  length  of  stay  by  diagnosis. 

Standards  —  the  desired  level  of  compliance  with  criteria  or  norms.  Standards 
sometimes  refer  to  criteria  which  have  been  validated  by  outcomes  evaluation. 

Normative  Criteria  —  criteria  determined  by  the  consensus  of  selected  commit- 
tees. 
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Critical  Criteria  —  those  anticipated  to  best  discriminate  among  physicians  or 
thought  most  important  to  good  care. 

Clerical  Guidelines  —  minimal  criteria  to  enable  non-professional  review  and 
indicate  cases  in  which  professional  review  is  required. 

Regional  —  refers  to  any  designated  geographic  area  rather  than  the  specific 
geography  of  the  Federal  health  regions. 

Population  Based  Data  —  refers  to  health  measures  or  the  utilization  of  services 
per  unit  of  population  defined  by  geographic  or  demographic  characteristics. 
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APPENDIX  C 
BIBLiOGRAPHY 


This  unannotated  bibliography  on  the  state  of  the  art  of  medical  care 
appraisal  was  developed  from  existing  materials  by  careful  collation  of  a  series  of 
both  annotated  and  unannotated  bibUographies  and  from  key  references  cited. 
References  actually  studied  by  our  staff  are  starred.  Key  references,  in  the 
opinion  of  our  staff,  are  underUned. 

The  source  materials  used  to  develop  the  bibliography  included,  but  were  not 
limited  to: 

•  Health  Services  Research  Bibhography,  John  W.  Williamson,  M.D., 
1969. 

•  Evaluating  the  Quality  of  Health  Care,  Selected  Bibliography,  HSMHA 
Library,  No.  72-2,  May  15,  1972. 

•  Health  Services  Research  Bibhography,  1972-73,  John  W.  Williamson 
and  James  B.  Tenney. 

•  Selected  Bibhography  of  Social,  Cultural,  Economic,  and  Behavioral 
Factors  Relevant  to  Health  and  Health  Care  Delivery  prepared  by  the 
Regional  Medical  Program  Service. 

•  Utihzation  Review,  A  Selected  Bibhography  1933-1969, 
Donald  C.  Reidel,  Ph.D. 

•  The  Impact  of  Medicare,  An  Annotated  Bibliography  of  Selected 
Sources,  Mary  McGee,  Social  Security  Administration,  1969. 

•  Planning  for  Hospital  Discharges,  A  Bibhography  with  Abstracts  and 
Research  Review,  1970,  Center  for  Community  Health  and  Medical 
Care,  Harvard  University. 

•  Methodology  in  Evaluating  the  Quahty  of  Medical  Care,  An  Anno- 
tated Selected  Bibliography,  1955-1968,  Altman,  Anderson  and 
Barker. 
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•  A  Guide  to  Medical  Care  Administration,  Volume  II:  Medical  Care 
Appraisal,  Avedis  Donabedian,  M.D. 

•  Report  of  the  Conference  on  Hospital  Discharge  Abstracts  Systems, 
Medical  Care,  8:  No.  4,  Supplement,  1970. 

•  Utilization  Review  Bibliography,  Utilization  Review  Training 
Institute  conducted  by  Hospital  Utilization  Project  of  Western 
Pennsylvania. 

•  Evaluating  Outcomes  of  Health  Services,  An  Annotated  Bibliography, 
Bonnie  Winters  Klein,  1970. 

•  An  Inventory  of  Medical  Care  Appraisal  Activities,  George  Goldberg, 
M.D.,  Community  Health  Services,  1972. 

We  would  also  like  to  acknowledge  the  assistance  given  to  us  by 
Mr.  August  La  Rocca  and  the  opportunity  to  use  the  hbrary  at  the  Center  for 
Community  Health  and  Medical  Care,  Harvard  University. 

While  the  terms  used,  and  the  number  of  subclassifications  included,  may 
vary,  there  is  common  agreement  among  most  authorities  that  the  spectrum  of 
medical  care  appraisal  includes: 

•  The  organizational  structure  and  the  professional  capacity  to  provide 
care; 

•  The  process  by  which  care  is  actually  provided ;  and 

•  The  outcomes  or  results  of  the  care  provided. 

Our  bibliography  has  been  organized  to  conform  to  this  common 
perception. 

State-of-the-art  papers  were  prepared,  and  included  in  this  volume,  cover- 
ing those  aspects  of  medical  care  appraisal  most  pertinent  to  peer  review.  These 
papers  were  developed  by  study  of  the  references  starred  in  the  bibliography. 

Since  the  literature  in  this  field  has  already  been  excellently  described  by 
the  monographs  and  annotated  bibliographies  described  above,  we  made  no 
effort  to  comprehensively  review  the  entire  literature;  rather  we  attempted  to 
abstract  from  the  literature  and  analyze  those  available  techniques  which  are 
pertinent  to  peer  review  in  PSRO's,  EMCRO's,  or  other  organized  agents  designed 
to  improve  and  protect  the  quality  of  medical  care. 
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